Senior Data Engineer Job at Brillio, Atlanta, GA

dUUvbFRGOUVZTmJsb2xkN2VpUHc3Um5kR2c9PQ==
  • Brillio
  • Atlanta, GA

Job Description

  • Role: Senior Data Engineer
  • Location: Atlanta, GA
  • Full-Time
  • The ideal candidate will have extensive expertise in data engineering, with a focus on data warehousing, Snowflake, streaming data pipelines, Kafka, Debezium, BI and reporting tools, embedded reporting, and ETL processes. This role will involve designing, implementing, and optimizing scalable data solutions to support business intelligence, analytics, and AI/ML needs.
  • Key Responsibilities

    • Data Pipeline Development: Design, build, and maintain robust ETL/ELT pipelines for efficient data ingestion, transformation, and integration from diverse sources.
    • Data Warehousing: Architect and optimize data warehouse solutions using Snowflake, ensuring scalability, performance, and reliability.
    • Streaming Data Pipelines: Develop and manage real-time data streaming pipelines using technologies such as Kafka and Debezium.
    • ERP Integration: Collaborate with ERP system teams to ensure seamless integration of enterprise data into the data ecosystem. Understand SSO, embedded reporting scenarios.
    • BI and Reporting: Work with BI tools (e.g., OAS, Domo, etc) to enable embedded reporting solutions and provide actionable insights.
    • Data Modeling: Design scalable data models (e.g., star schema, snowflake schema) to support analytics and reporting needs.
    • Collaboration: Partner with cross-functional teams including to understand requirements and deliver tailored solutions.
    • System Monitoring & Optimization: Monitor system performance, troubleshoot issues, and implement optimizations to enhance efficiency.

    Required Skills & Qualifications Technical Expertise:

    • Proficiency in Snowflake architecture and SQL for complex queries.
    • Hands-on experience with Kafka for real-time data streaming.
    • Familiarity with cloud platforms such as AWS and Azure.
    • Knowledge of ERP systems integration.

    Data Engineering Skills:

    • Expertise in data modeling techniques (e.g., star schema, snowflake schema).
    • Solid understanding of access control mechanisms and SSO protocols.
    • Experience in designing scalable ETL/ELT pipelines.

    Soft Skills:

    • Strong problem-solving abilities in ambiguous environments.
    • Excellent communication skills for collaborating across teams.

    Preferred Qualifications

    • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
    • Experience migrating on-premise systems to cloud-based platforms.
    • Familiarity with modern CI/CD pipelines for deployment automation.

Job Tags

Full time,

Similar Jobs

AP&T Group

Key Account Manager Job at AP&T Group

 ...company. ~ Global collaborationWork alongside colleagues across North America and internationally, and interact regularly with our Swedish headquarters. ~ A competitive compensation package with excellent benefits, including: ~ Comprehensive health insurance for you... 

The Oregon Fruit Company

Plant Engineer & Maintenance Manager Job at The Oregon Fruit Company

 ...the things we grow in Oregon: Craft, Community and Fruit. The Plant Engineering and Maintenance Manager is responsible for leading...  ...places; fumes or airborne particles; toxic or caustic chemicals and risk of electrical shock. Work in hot and cold environments... 

Beacon Hill

Pharmacy Order Fulfilment Job at Beacon Hill

 ...and standard operating procedures. Verifies and documents all order components, including batch numbers, expiration dates, and...  ...safety standards. Maintains cleanliness and organization of the fulfillment area, adhering to strict hygiene protocols to prevent... 

Lyte Fiber, LLC

OSP Construction Inspector Job at Lyte Fiber, LLC

 ...Position Description: The Construction Inspector will be responsible for the successful execution of several fiber construction projects and the ongoing upkeep and repairs required to maintain and deliver reliable high-speed internet, all of this across multiple markets... 

Iceberg

eDiscovery Staff Attorney Job at Iceberg

 ...My client is seeking an eDiscovery Staff Attorney with a minimum of 4 years of eDiscovery experience, including discovery project management...  ...track position. This role is a hybrid in-office / remote work schedule to provide our attorneys greater flexibility....