Home
/
Comprehensive
/
AWS Databricks Data Engineer - Solution Specialist
AWS Databricks Data Engineer - Solution Specialist-March 2024
Mechanicsburg
Mar 28, 2026
About AWS Databricks Data Engineer - Solution Specialist

Are you an experienced, passionate pioneer in technology - a solutions builder, a roll-up-your-sleeves technologist who wants a daily collaborative environment, think-tank feel and share new ideas with your colleagues - without the extensive demands of travel? If so, consider an opportunity with our US Delivery Center - we are breaking the mold of a typical Delivery Center.

Our US Delivery Centers have been growing since 2014 with significant, continued growth on the horizon. Interested? Read more about our opportunity below ...

Work you'll do/Responsibilities

Work with the team to evaluate business needs and priorities, liaise with key business partners and address team needs related to data systems and management.

Translate business requirements into technical specifications; establish and define details, definitions, and requirements of applications, components and enhancements.

Participate in project planning; identifying milestones, deliverables and resource requirements; tracks activities and task execution.

Generate design, development, test plans, detailed functional specifications documents, user interface design, and process flow charts for execution of programming.

Develop data pipelines / APIs using Python, SQL, potentially Spark and AWS, Azure or GCP Methods.

Use an analytical, data-driven approach to drive a deep understanding of fast changing business.

Build large-scale batch and real-time data pipelines with data processing frameworks in AWS, Azure or GCP cloud platform.

Moving data from on-prem to cloud and cloud data conversions.

The Team

Artificial Intelligence Data Engineering:

In this age of disruption, organizations need to navigate the future with confidence, embracing decision making with clear, data-driven choices that deliver enterprise value in a dynamic business environment.

The Artificial Intelligence Data Engineering team leverages the power of data, analytics, robotics, science and cognitive technologies to uncover hidden relationships from vast troves of data, generate insights, and inform decision-making. Together with the Strategy practice, our Strategy Analytics portfolio helps clients transform their business by architecting organizational intelligence programs and differentiated strategies to win in their chosen markets.

Artificial Intelligence Data Engineering will work with our clients to:

Implement large-scale data ecosystems including data management, governance and the integration of structured and unstructured data to generate insights leveraging cloud-based platforms.

Leverage automation, cognitive and science-based techniques to manage data, predict scenarios and prescribe actions.

Drive operational efficiency by maintaining their data ecosystems, sourcing analytics expertise and providing As-a-Service offerings for continuous insights and improvements.

Qualifications Required

Must be legally authorized to work in the United States without the need for employer sponsorship, now or at any time in the future.

3+ years of experience in data engineering with an emphasis on data analytics and reporting.

3+ years of experience with at least one of the following cloud platforms: Microsoft Azure, Amazon Web Services (AWS), Google Cloud Platform (GCP), others.

3+ years of experience in SQL, data transformations, statistical analysis, and troubleshooting across more than one Database Platform (Cassandra, MySQL, Snowflake, PostgreSQL, Redshift, Azure SQL Data Warehouse, Databricks, etc.).

3+ years of experience in the design and build of data extraction, transformation, and loading processes by writing custom data pipelines.

3+ years of experience with one or more of the follow scripting languages: Python, SQL, Kafka and/or other.

3+ years of experience designing and building solutions utilizing various Cloud services such as EC2, S3, EMR, Kinesis, RDS, Redshift/Spectrum, Lambda, Glue, Athena, API gateway, etc.

Bachelor's degree, preferably in Computer Science, Information Technology, Computer Engineering, or related IT discipline, or equivalent experience

Ability to travel 10%, on average, based on the work you do and the clients and industries/sectors you serve. This may include overnight travel.

Must be able to obtain the required level of security clearance for this role

Must live in a commutable distance (approximately 100-mile radius) to one of the following Delivery locations: Atlanta, GA; Charlotte, NC; Dallas, TX; Gilbert, AZ; Houston, TX; Lake Mary, FL; Mechanicsburg, PA; Philadelphia, PA with the ability to commute to assigned location for the day, without the need for overnight accommodations

Expectation to co-locate in your designated Delivery location up to 30% of the time based on business needs. This may include a maximum of 10% overnight client/project travel

Preferred

AWS, Azure and/or Google Cloud Platform Certification.

Master's degree or higher.

Expertise in one or more programming languages, preferably Scala, PySpark and/or Python.

Experience working with either a Map Reduce or an MPP system on any size/scale.

Experience working with agile development methodologies such as Sprint and Scrum.

Must be able to obtain the required level of security clearance for this role

Information for applicants with a need for accommodation: https://www2.deloitte.com/us/en/pages/careers/articles/join-deloitte-assistance-for-disabled-applicants.html

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability or protected veteran status, or any other legally protected basis, in accordance with applicable law.

Comments
Welcome to zdrecruit comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
SIMILAR JOBS
Counsel II Litigation
More information about this job: Overview: This is a US office based position that will require in office presence at our headquarters located in Johnston, RI four days a week with flexibility for on
Registered Nurse RN Medical Surgical Med Surg Urology
Details Sign-on bonus: $20,000 Department: Medical Surgical Med Surg Urology Schedule: Full Time Night Shift 3x12s 7:00 p.m. - 7:00 a.m. with 7 day per week availability, weekend and holiday shifts r
Teller
Location: 20974 State Rte 3 - Watertown, New York 13601 Job Summary Be a problem solver, trusted advisor, and partner to the people and businesses in our Key Bank communities. As a Teller, you provid
Retail Maintenance
Req ID: 429308 Address: 2001 State Route 540 Bellefontaine, OH, 43311 Welcome to Love’s! Where People are the Heart of Our Success Retail Maintenance Maintenance Techs help run our business by keepin
Deli Production Team Member
Company Description Pay Rates Starting between: $12.60 - $17.58 / hour Are you passionate about team building, customer service, and meeting new people? Pilot Company offers a dynamic environment whe
Trailer Mechanic Level B
Job Summary: Responsible for repairs and required preventive maintenance of trailers Inspect, trouble shoot, diagnose, and perform maintenance on equipment Perform safety inspections of equipment and
Test Engineer
Overview GovCIO is currently hiring a Software Test Engineer to support our client’s contract needs. This position is located in Washington, DC and will be a hybrid remote position. Responsibilities
Registered Nurse ICU Medical Nights
Description All the benefits and perks you need for you and your family: · Paid Days Off from Day One · Student Loan Repayment Program · Career Development · Whole Person Wellbeing Resources · Mental
Helpdesk Technician
Vaccination & first booster shot IS REQUIRED* Description: This healthcare client is looking for a seasoned Help Desk technician to join their call center in Statford, CT. This person will be han
Development Manager
Everything we do at Sunrun is driven by a determination to transform the way we power our lives. We know that starts at the individual employee level. We strive to foster an environment you can thriv
Copyright 2023-2026 - www.zdrecruit.com All Rights Reserved