Senior Software Engineer

As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining high-performance data pipelines and architectures. Your work will ensure seamless integration and processing of vast data sets using modern technologies such as Python, PostgreSQL, MongoDB, Jupyter, AWS, and Azure Databricks. You will collaborate closely with cross-functional teams, including data scientists and analysts, to deliver insights that drive our strategic initiatives. 

Key Responsibilities: 

The job responsibilities for this position will include but are not limited to: 

• Data Pipeline Development: 
  

• Design, implement, and optimize scalable data pipelines and ETL processes using Python. 
  

• Integrate and manage data from diverse sources to ensure data quality and consistency. 
  

• Database Management: 
  

• Develop and maintain data storage solutions leveraging PostgreSQL for relational data and MongoDB for NoSQL applications. 
  

• Optimize database performance and ensure efficient querying and data retrieval. 
  

• Data Analysis & Prototyping: 
  

• Utilize Jupyter notebooks for exploratory data analysis, prototyping, and reporting. 
  

• Collaborate with data science teams to support analytics and machine learning initiatives. 
  

• Cloud Data Solutions: 
  

• Manage and optimize data workflows on AWS and Azure Databricks, ensuring reliability and scalability of data infrastructure. 
  

• Implement best practices for data security, governance, and compliance on cloud platforms. 
  

• DevOps & Cloud Services: 
  

• Deploy, monitor, and maintain applications in cloud environments (Azure and AWS). 
  

• Utilize CI/CD pipelines to automate testing and deployment. 
  

• Collaboration & Leadership: 
  

• Work closely with product managers, designers, and other developers to deliver high-quality features. 
  

• Provide mentorship to junior team members and conduct code reviews to maintain code quality. 
  

• Best Practices: 
  

• Ensure compliance with industry standards for security, performance, and maintainability. 
  

• Stay up to date with emerging technologies and recommend adoption as appropriate. 
  

Required Skills & Qualifications: 

• Programming Languages & Frameworks: 
  

• Strong proficiency in Python and JavaScript/TypeScript. 
  

• Expertise in React.js for frontend development. 
  

• Proficiency in Django and Django Rest Framework (DRF) for backend development. 
  

• Cloud Expertise: 
  

• Hands-on experience with Azure and AWS services (e.g., EC2, S3, RDS, Azure Functions, Azure App Service). 
  

• Knowledge of serverless architecture and containerization (Docker, Kubernetes). 
  

• Database Management: 
  

• Proficiency in PostgreSQL, including writing complex queries, optimizing performance, and schema design. 
  

• DevOps & Tools: 
  

• Experience with CI/CD tools (e.g., Jenkins, GitHub Actions, Azure DevOps). 
  

• Familiarity with infrastructure-as-code tools like Terraform or CloudFormation. 
  

• Soft Skills: 
  

• Excellent problem-solving skills and attention to detail. 
  

• Strong communication and collaboration abilities. 
  

• Ability to lead and mentor a team effectively. 
  

• Strong management skills 
  

• Education: 
  

• Must be a BS / MS graduate with 3.0 GPA or higher 
  

• Interpersonal Skills 
  

• Excellent interpersonal, verbal, and written communication. 
  

• Exceptional organizational skills and attention to detail.