Data Engineer (Python + Azure Databricks + SQL job at Diverse Lynx Windsor Locks, CT, US

Job Description

Position: Data Engineer ( Python + Azure Databricks + SQL) Location: Hartford, CT/Stamford, CT- Day 1 Onsite Position Type: Contract This position will see you responsible for liaising with the business to gather requirements, working with the team to identify potential tools and through the migration on to a centralized platform consolidate data sources. Roles and Responsibilities:

Analyses current business practices, processes, and procedures as well as identifying future business opportunities for leveraging Microsoft Azure Data & Analytics Services.
Engage and collaborate with customers to understand business requirements/use cases and translate them into detailed technical specifications.
Experience with Python/Pyspark frameworks/libraries.
Expertise of Azure Databricks.
Experienced of SQL.
Experience in designing and implementing complex ETL and process flows
Expertise across data transformation frameworks.
Good to have Azure/Azure DevOps knowledge.
Configuration Management, CI/CD and Cloud
Develop best practices including reusable code, libraries, patterns, and consumable frameworks for cloud-based data warehousing and ETL.
Maintain best practice standards for the development or cloud-based data warehouse solutioning including naming standard

Experience:

Good understanding of the platform and the code/integration behind.
Want to upgrade the system to be the most efficient version.
5-7 years of experience in a Data Engineer role.
Strong knowledge in data modeling, data warehousing, and ETL processes.
Strong knowledge of database management systems (e.g., SQL Server, Oracle, MySQL).
Experience with Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Synapse Analytics, and other Azure data services.
Familiarity with data governance, data quality, and data security best practices.
Experience with DevOps practices, agile methodologies, and collaboration tools.

Key Skills Required:

Python + Azure Databricks + SQL
Experience in designing and hands-on development in cloud-based analytics solutions.
Expert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service is required.
Designing and building of data pipelines using API ingestion and Streaming ingestion methods.
Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code is essential.
Experience in developing NO SQL solutions using Azure Cosmos DB is essential.

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company. Diverse Lynx

Job Tags

Contract work,

Similar Jobs

Allied Universal®

Security Guard Job at Allied Universal®

...Job Description Company Overview: Allied Universal, North Americas leading security and facility services company, offers rewarding careers that provide you a sense of purpose. While working in a dynamic, welcoming, and collaborative workplace, you will be part...

NSC

Entry Level Technical Recruiter Job at NSC

...people? Do you like getting paid for the effort you put forth? Come join our team at NSC Technologies! As a member of the NSC Recruiting Team, you will work alongside other sales minded individuals in a friendly, team-oriented environment to achieve a common goal. You...

Lomographic Society International

Marketing & Partnerships Associate North America (New York) Job at Lomographic Society International

...Marketing & Partnerships Associate North America Full-time - Brooklyn, NY As our Marketing & Partnerships Associate for North America... ...and to catapult your shots around the globe through our online platform. Responsibilities Brainstorm and conceptualize marketing...

Target

Target Merchandise and Food Expert Job at Target

...we value, and how we work. It's how we care, grow, and win together. We work together to provide the guest a fresh, full, and food safe shopping experience all day, every day. ALL ABOUT FOOD & BEVERAGE The Food & Beverage team enables a consistent experience...

MCI

4X10 Telephone Sales Agent (4-Days, 40hrs./wk) Job at MCI

...will need to be confident, fully engaged, a team player, and dedicated to bringing a positive and enthusiastic outlook to work each day. Key Responsibilities: Handle inbound and outbound customer interactions professionally and efficiently Understand customer...