Job#: 2058492

Job Description:

Position: Senior Spark Data Engineer

Direct Hire

100% Remote

Apex Systems is seeking a Senior Spark Data Engineer for a Direct-Hire position that is 100% remote. You will be joining an innovating Data team to help drive our recent Databricks adoption. The ideal candidate will have a deep background in Data Engineering and can help lead our Data Unification & Optimization approach.

Must Have Qualifications:

· 10+ years of enterprise-level Data Engineering and/or Software Development

· 4-5 years’ experience Spark

· Advanced in Python or PySpark

· Databricks background OR Databricks Spark

· Managing and tuning of Data Lake and Lakehouse storage objects with accompanying data engineering pipelines.

Job Duties/Responsibilities:

· Serve as the subject matter expert in technologies used for our data strategy in the cloud.

· Help drive Adoption of Spark DataBricks across the organization

· Facilitate and drive our Data Unification & Optimization approach

· Design, develop, optimize, and maintain data architecture and pipelines that adhere to ETL principles and business goals

· Solve complex data problems to deliver insights that helps the organizations business to achieve their goals

· Create data products for analytics and data scientist team members to improve their productivity

· Foster a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytical solutions

· Lead the evaluation, implementation and deployment of emerging tools and process for analytic data engineering to improve the organizations productivity as a team

· Partner with business analysts and solutions architects to develop technical architectures for strategic enterprise projects and initiatives.

Nice to Have:

· Kafka or JAVA background (Observability)

· Apache Iceberg or other similar tools such as Monte Carlo

· SQL, Azure Data Factory

· Experience in designing and/or developing Analytics applications using tools such as Power BI, QlikView, SAS, RapidMiner or other comparable products.

· Experience in creating, analyzing and documenting ER and Dimensional models.

Education:

· Bachelors degree in computer science, MIS or a related field + 10 years of relative experience.

Apex Systems is a world-class IT services company that serves thousands of clients across the globe. When you join Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including ClearlyRated's Best of Staffing® in Talent Satisfaction in the United States and Great Place to Work® in the United Kingdom and Mexico.