Back to results: data analytics courses for working professionals / US

Key Data Engineer (Python / Scala / Azure)

EPAM Systems

Posted on: 06 Mar 2024

Job Location: Atlanta, US

Job Description:

DescriptionWe are looking for a Key Data Engineer to join the project in the financial services industry. This role combines technical and people management skills for the data platform that require knowledge of financial data, big data processing and management, as well as cloud-based data warehouse solutions.What You ll DoBuild and maintain secure and compliant production data processing pipelines by using different tools and techniques (cloud services, Python/Scala)Ensure that data pipelines and stores are high-performing, efficient, organized, and reliable, given business requirements and constraintsDesign, implement, monitor and optimize data platforms to meet the data pipeline needsResponsible for data-related implementation tasks: provisioning data storage services, ingesting streaming and batch data, transforming data, implementing security requirements, implementing data retention policies, identifying performance bottlenecks and accessing external data sourcesDesign and operationalize large-scale enterprise data solutions and applications using one or more Azure data and analytics servicesImplement data solutions that use the following Azure services: Azure Cosmos DB, Azure Synapse Analytics, Azure Data Factory, Azure Stream Analytics, Azure Databricks, Azure Blob storage, Microsoft Purview, etcIntegrate, transform and consolidate data from various structured and unstructured data systems into a structure suitable for building analytics solutionsDesign and implement data engineering, ingestion and curation functions on Azure cloud using Azure native or custom programmingCreate data transformation and loading workflowsWhat You HaveExperience in Data Platforms and Azure s PaaS offerings (Synapse, Purview, ADF, Databricks, Azure Data Lake Storage)Competency in Azure: Synapse Analytics, Data Factory, Data Lake, Databricks, Microsoft Purview, Monitor, SQL Database, SQL Managed Instance, Stream Analytics, Cosmos DB, Storage Services, ADLS, Azure Functions, Log Analytics, Serverless Architecture, ARM TemplatesProficiency in data processing languages such as SQL, Java, Python or ScalaStrong notions of security best practices (e.g., using Azure Key Vault, IAM, RBAC, Monitor, etc.)Understanding the data through exploration and experience with data retention, validation, visualization, preparation, matching, fragmentation, segmentation and enhancement processesFamiliarity with Azure Networking conceptsCertifications Preferred: DP-203: Data Engineering on Microsoft Azure and DP-900: Microsoft Azure Data Fundamentals We offerOutstanding career development opportunities with a transparent roadmap to accelerate your journeyKnowledge sharing within the community of the industry s top professionals worldwideVarious opportunities for self-development: hard & soft skills internal training courses, mentoring programs, and unlimited access to 8,000+ LinkedIn Learning coursesFree English classes with certified teachersCompetitive compensation, regular assessments, and salary reviewsParticipation in the Employee Stock Purchase PlanFlexible working scheduleFriendly team and enjoyable working environmentBonuses for participating in the referral programRelocation opportunities within our offices in 50+ countriesSocial package medical & family careFive trust days a year (sick leave without a medical certificate)About EPAMEPAM Georgia is a team of innovators united by a passion for technology. The dynamic and inclusive culture we embrace helps positively impact our communities, customers, and employees. Here you will collaborate with multi-national teams, contribute to numerous cutting-edge projects, deliver the most creative solutions, and have an opportunity to learn. Our people are at the heart of our success, and we are proud to provide talents with a solid ground to develop and grow

Apply

Similar jobs

Key Data Engineer (Python / Scala / Azure)

Atlanta, US

06 Mar 2024

Key Data Engineer (Python / Scala / Azure)

Atlanta, US

06 Mar 2024

Key Data Engineer (Python / Scala / Azure)

Atlanta, US

06 Mar 2024

Key Data Engineer (Python / Scala / Azure)

Atlanta, US

06 Mar 2024