Innova Solutions is immediately hiring for a Sr. Azure Data Engineer Position type: Full-time Perm Role Duration: Permanent Role Location: Collegeville, PA As a Sr. Azure Data Engineer you will: Job Description: We are looking for a highly skilled and experienced Senior Data Engineer to join our growing CMC Data Engineering team. This software practitioner will work with a team of talented data engineers focused on building data as products following data mesh principles for CMC. They will drive scale and automation by providing expert technical skills and implementing cloud-based data ingestion and processing patterns i.e., 'end to end data workflows' to address specific 'data as a product' challenges. This team would partner closely with the Platforms and Data Architecture and Domain functions. The Senior Data Engineer will contribute to the design, development, testing and release of pipelines, workflows, microservices, within a well-defined architecture and detailed specification. They will carry out common maintenance and support tasks on existing data services. Other responsibilities include: * Diagnose bugs or scaling issues and know when to escalate to more senior engineers to fully solve a problem. * Scan the external environment, identify, and apply cloud-based tools/methods targeting common data ingestion/processing challenges * Follow the best knowledge and data services practices and standards/guidelines for engineering process, producing clean, readable, well-documented code, and releasing appropriately tested, API accessible data services. * Operate in a fast-paced environment driving innovation through rapid prototyping and iterative development ensuring quality is built into all solutions. * Utilise expertise of developing data as a product for high throughput with RESTful APIs using microservices, with demonstrable large production-scale experience. Design, develop, code, and test complex technical solutions collaborating with other engineers. Perform code/design reviews to ensure smooth daily operations. Perform code merges, resolve merge conflict, and manage code branch. Competitive candidates will have a proven track record of excellent coding and software development within high-performing engineering teams, and shipping products. They will be comfortable working in an Agile software development environment and be a team player, eager to invest in personal and team growth. The Senior Data Engineer should demonstrate core engineering knowledge/experience of industry technologies, practices, and frameworks such as Data Mesh and scaling data platforms, containerization, cloud-based platforms, data analytics, and data streaming. Examples of technologies include but not limited to Python, Denodo, GIT, Azure DevOps, Data Bricks, Spark, Azure Data Factory, ADLS V2, Kafka, Selenium, JUnit/NUnit, SAFe, Kanban, Docker, Azure Cloud Architecture including networking principles and scaling applications. Primary responsibilities include the following: * Using Azure cloud services and data platform tools to ingest, egress, and transform data from multiple sources. * Confidently optimizes the design and execution of complex solutions in data ingestion and data transformation * Produces well-engineered software, including appropriate automated test suites, technical documentation, and operational strategy * Provides input into the roadmaps of upstream teams (e.g., Data Platforms, DataOps, DevOps) to help improve the overall program of work * Ensure consistent application of platform capabilities to ensure quality and consistency concerning logging and lineage * Fully versed in coding best practices and ways of working, and participates in code reviews and partnering to improve the team's standards * Adhere to QMS framework, Security & Regulatory Standards, and CI/CD best practices and helps to guide improvements to them that improve ways of working * Provide leadership to team members to help others get the job done righ * Supporting engineering teams in the adoption and creation of data Mesh best practices. * Maintains best practices for engineering and architecture on our Confluence site. * Pro-actively engages in experimentation and innovation to drive relentless improvement Why you? Basic Qualifications: We are looking for professionals with these required skills to achieve our goals: * Computer Science or related bachelor's degree - MS in Computer Science is preferred * Proficient with at least 3 of the below skills and can demonstrate knowledge and value with relevant experience in all the following competencies: * Data Engineering development, architecture design & technology platforms/frameworks * Hands-on experience with Azure Data Analytics services e.g. ADLS, Azure Data Factory, Azure Databricks, Purview, Azure Synapse, etc. * Data Platforms and Domain-driven design * Agile, DevOps & Automation [of testing, build, deployment, CI/CD, etc.] * Data analytics & data quality/integrity * Testing strategies & frameworks * Role requires: * Demonstrated skill in delivering high-quality engineered data products * Knowledge of industry standards and technology platforms * Excellent communication, negotiation, influencing, and stakeholder management skills * Customer focus and excellent problem-solving skills * Familiarity with and use of various open-source ecosystems including JavaScript, Bigdata, java, python, etc. * Good understanding of various software paradigms: domain-driven, procedural, data-driven, object-oriented, functional * Familiar with Java, Scala, Python * Demonstrable knowledge depth in more than one area of software engineering and technology Preferred Qualifications: If you have the following characteristics, it would be a plus: * Track record of applying best data and software engineering practices in Pharma CMC and Scientific domains. * Known for excellent, rigorous software engineering with full stack role including DevOps on a development team * Experience in applying data curation, virtualization, workflow, and advanced visualization techniques to enable decision support across multiple products and assets to drive results across R&D business operations. * Experience in building products with modern Cloud architectures, platforms, and back-end systems Qualified candidates should APPLY NOW for immediate consideration! Please hit APPLY to provide the required information, and we will be back in touch as soon as possible. We are currently interviewing to fill this and other similar positions. If this role is not a fit for you, we do offer a referral bonus program for referrals that we successfully place with our clients, subject to program guidelines. ASK ME HOW. Thank you! Preeti Sehgal [email protected] PAY RANGE : Pay Range*: $140K - $160K *Pay range offered to a successful candidate will be based on several factors, including the candidate's education, work experience, work location, specific job duties, certifications, etc. ABOUT INNOVA SOLUTIONS: Founded in 1998 and headquartered in Atlanta, Georgia, Innova Solutions employs approximately 50,000 professionals worldwide and reports an annual revenue approaching $3 Billion. Through our global delivery centers across North America, Asia, and Europe, we deliver strategic technology and business transformation solutions to our clients, enabling them to operate as leaders within their fields. Recent Recognitions: * One of Largest IT Consulting Staffing firms in the USA - Recognized as #4 by Staffing Industry Analysts (SIA 2022) * ClearlyRated® Client Diamond Award Winner (2020) * One of the Largest Certified MBE Companies in the NMSDC Network (2022) * Advanced Tier Services partner with AWS and Gold with MS Website: https://www.innovasolutions.com/ Innova Solutions is an Equal Opportunity Employer and prohibits any kind of unlawful discrimination and harassment. Innova Solutions is committed to the