Databricks Data Engineer Job at Smart IT Frame LLC, New York, NY

M2lEYVozQ2IyZkxCVWZVMXZiL0JxczE2Z1E9PQ==
  • Smart IT Frame LLC
  • New York, NY

Job Description

Job Title: Databricks Data Engineer

Location: NYC, NY (Hybrid)

Work Type: Full Time

Job Description:-

· This role will be part of the Data Strategy team spanning across the client Capital Markets and securities teams, Americas Division’s broker-dealer and swap-dealer entities.

· This role will be involved in the active development of the data platform in close coordination with the team, beginning with the establishment of a reference data system for securities and pricing data, and later moving to other data domains.

· The consulting team will need to follow internal developments standards to contribute to the overall agenda of the Data Strategy team.

· The implementation of this strategic platform on client’s Azure Cloud Platform will require solutions and know-how as listed in the qualifications below.

Qualifications and Skills

· 10+ years of experience in software development using Python, PySpark and its frameworks.

· Proven experience as a Data Engineer with experience in Azure cloud.

· Experience implementing solutions using -

o Azure cloud services

o Azure Data Factory

o Azure Lake Gen 2

o Azure Databases

o Azure Data Fabric

o API Gateway management

o Azure Functions

· Well versed with Azure Databricks

· Strong SQL skills with RDMS or noSQL databases

· Experience with developing API’s using FastAPI or similar frameworks in Python

· Familiarity with the DevOps lifecycle (git, Jenkins, etc.), CI/CD processes

· Good understanding of ETL/ELT processes

· Experience in financial services industry, financial instruments, asset classes and market data are a plus.

Job Tags

Full time,

Similar Jobs

MCI

4X10 Telephone Sales Agent (4-Days, 40hrs./wk) Job at MCI

 ...will need to be confident, fully engaged, a team player, and dedicated to bringing a positive and enthusiastic outlook to work each day. Key Responsibilities: Handle inbound and outbound customer interactions professionally and efficiently Understand customer... 

People First Service Center

Senior Attorney | Public Sector Legal Counsel Job at People First Service Center

 ...A Florida state agency is seeking a Senior Attorney to provide legal services within the Department, focusing on employment verification and legal counsel across various departments. The role will involve assisting with policy development, handling litigation, and providing... 

Baldwin Moffitt Behm LLP

Auditor - public accounting - Manager Job at Baldwin Moffitt Behm LLP

 ...as the primary point of contact for audit clients. Evaluate accounting and auditing issues and ensure proper GAAP application....  ...policies, and regulatory requirements Qualifications: ~ Bachelors degree in Accounting and Certified Public Accountant License... 

CRH

Corporate Recruiter (Entry Level) Job at CRH

 ...projects of all sizes. Job Summary We are looking to add a Corporate Recruiter to focus on recruiting non-exemptpositionsforlocations across the nation. This is an excellent entry level position on our team. Job Location This is a hybrid role based... 

Tyndale

Business Development Representative Job at Tyndale

 ...Job Description Job Description Overview Tyndale's Sales department is growing and we're hiring a Business Development Representative (BDR) to join the team! Our BRD's qualify large, cold prospects into warm opportunities that can be handed off to the National...