Talent.com
Hadoop/Python Engineer
Hadoop/Python EngineerITR Group • Brooklyn Park, MN, United States
serp_jobs.error_messages.no_longer_accepting
Hadoop / Python Engineer

Hadoop / Python Engineer

ITR Group • Brooklyn Park, MN, United States
job_description.job_card.30_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Contract consulting opportunity for an experienced Machine Learning Engineer with Hadoop / Python experience.

  • Hybrid onsite (approx 2-3 days / week) - Must be local to Minneapolis metro
  • Client work authorization requirements : US Citizen or GC holder
  • W2 hourly only (No C2C)
  • Must have experience with Hadoop, Spark, Python, Orchestration

Seeking a Machine Learning Engineer to support and maintain critical batch jobs responsible for generating high-volume forecasts. These jobs are scheduled using a proprietary in-house scheduler and run R, Python, Bash, and Spark on an in-house YARN-managed cluster.

You will play a key role in enabling smooth day-to-day operations by watching, restarting, and debugging jobs in order to minimize downtime and system reliability. Besides operations, you will also contribute towards code enhancements, performance optimization, and observability instrumentation to improve workflow efficiency and stability.

Responsibilities

  • Manage, debug, and oversee day-to-day batch jobs and Spark-based forecasting pipelines.
  • Diagnose and resolve performance, reliability, and dependency issues in distributed environments.
  • Develop and scale existing roles with Python (PySpark), Bash, and Terraform.
  • Develop and automate observability and monitoring features with OpenTelemetry (OTEL), Kibana, Grafana, and bespoke REST APIs.
  • Collaborate with cross-functional groups (Data Science, DevOps, Infrastructure) to integrate high system reliability.
  • Make code contributions to versioned repositories with GitHub, pull requests, code reviews, and branching models.
  • Identify continuous improvement opportunities in orchestration, monitoring, and job performance.
  • Must Have Skills

  • Apache Hadoop, Apache Hive, Apache Spark, and the Apache Spark ecosystem
  • Big Data technologies and distributed computing concepts
  • PySpark and Python development background
  • Docker for containerized environments
  • Git / GitHub for version control and collaboration
  • Nice to Have Skills

  • Workflow orchestration experience with Airflow or similar
  • Bash scripting for automation and environment setup
  • Experience with Grafana or Kibana for observability and monitoring
  • Knowledge of MLOps principles and tooling
  • Knowledge of OpenTelemetry (OTEL) for metrics and tracing
  • Working experience with R for model run or integration
  • Terraform for infrastructure-as-code management
  • Soft Skills

  • Excellent analytical and troubleshooting skills with high focus on details
  • Excellent communication and collaboration in cross-functional teams
  • Proactive, ownership-focused mindset with focus on reliability and performance optimization
  • This is an opportunity to make a tangible impact on a large-scale forecasting platform, working at the intersection of Machine Learning Operations, Data Engineering, and Infrastructure Automation. You'll collaborate with a technically strong team and contribute to both system stability and innovation.

    ITR Group offers a competitive compensation and benefits package, including medical, dental, and 401(k) for eligible employees. The W2 pay range for this type of role is approximately $70.00-89.00 per billable hour. This range is an estimate and not a guarantee of compensation. The final rate will be determined by factors such as experience, market trends, and specific job assignments. Discover more about how ITR Group connects top talent with leading client opportunities.

    serp_jobs.job_alerts.create_a_job

    Engineer • Brooklyn Park, MN, United States

    Job_description.internal_linking.related_jobs
    Senior Data Platform Engineer (28702) (Minnetonka)

    Senior Data Platform Engineer (28702) (Minnetonka)

    Dahl Consulting • Minnetonka, MN, US
    serp_jobs.job_card.part_time
    Senior Data Platform Engineer Oracle / Snowflake / Azure.Minnetonka, MN | Hybrid; onsite Tuesday - Thursday.Contract-to-Hire (6 months) •All candidates must be interested & eligible for conversion wit...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_1_day • serp_jobs.job_card.promoted
    Databricks Engineer

    Databricks Engineer

    KonnectingTree Inc • Eagan, MN, US
    serp_jobs.job_card.full_time
    We have a need for Azure Databricks Engineers.This is an onsite position and will be a long term engagement.Looking for candidates with 8-10 years of experience. Anyone with an ETL background in Inf...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Quick Reminder - Software Engineer / Developer - Minneapolis, MN - Onsite - Contract Role

    Quick Reminder - Software Engineer / Developer - Minneapolis, MN - Onsite - Contract Role

    Lorven Technologies • Minneapolis, MN, United States
    serp_jobs.job_card.full_time
    Role : Software Engineer / Developer.Location : Minneapolis, MN - Onsite.Only USC & GC - No GC from Employer's.Highly skilled C++ / Angular / AWS Expert with a strong understanding of data center infra...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Cloud Engineer

    Cloud Engineer

    Zone IT Solutions • Minneapolis, MN, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    We are looking for a Cloud Engineer, where you will be a key player in shaping our cloud strategy and enhancing the services we provide to our clients. In this role, you will design, implement, and ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30
    Solutions Engineer (Java / Azure)

    Solutions Engineer (Java / Azure)

    UnitedHealth Group • Eden Prairie, MN, United States
    serp_jobs.job_card.full_time
    Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives.The work you do with our team will directly improve health outcomes by connect...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Python Developer

    Python Developer

    Diverse Lynx • Minneapolis, MN, United States
    serp_jobs.job_card.full_time
    Design and develop RESTful web services using Python, with strong emphasis on scalable and maintainable API architecture. Integrate with external systems and third-party APIs (e.Contribute to the de...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Cloud Engineer

    Cloud Engineer

    Medica • Minnetonka, MN, United States
    serp_jobs.job_card.full_time
    Medica is a nonprofit health plan with more than a million members that serves communities in Minnesota, Nebraska, Wisconsin, Missouri, and beyond. We deliver personalized health care experiences an...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    AJO Developer

    AJO Developer

    Noblesoft Technologies • Minneapolis, Minnesota, USA
    serp_jobs.job_card.full_time
    Location : Minneapolis MN(Hybrid - 3 days a week).Job Description / Key Responsibilities : .Build and configure customer journeys and campaigns in AJO (email SMS push in-app).Implement journey orchest...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Cloud DataOps Engineer

    Senior Cloud DataOps Engineer

    Surescripts • Minneapolis, MN, United States
    serp_jobs.job_card.full_time
    We deliver insights at critical points of care for better decisions - from streamlining prior authorizations to delivering comprehensive medication histories to facilitating messages between provid...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior AWS Developer

    Senior AWS Developer

    Syntricate Technologies • Minneapolis, MN, United States
    serp_jobs.job_card.full_time
    Strong AWS skillset is a must with following services.EMR, Lambda, S3, Glue / Athena, API Gateway.Hands-on experience is a must in pySpark and Python. Should be able to work independently and should h...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    AJO Developer (Minneapolis)

    AJO Developer (Minneapolis)

    HCLTech • Minneapolis, MN, US
    serp_jobs.job_card.full_time +1
    HCLTech is looking for a highly talented and self-motivated.Location : Minneapolis, Minnesota, United States(Hybrid).Build and configure customer journeys and campaigns in AJO (email, SMS, push, in-...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_1_day • serp_jobs.job_card.promoted
    Cloud Deployment Engineer- Senior Associate

    Cloud Deployment Engineer- Senior Associate

    PwC • Minneapolis, MN, United States
    serp_jobs.job_card.full_time
    Platform Engineering & Architecture.At PwC, our people in integration and platform architecture focus on designing and implementing seamless integration solutions and robust platform architectures ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior API developer

    Senior API developer

    Artech • Minneapolis, MN, United States
    serp_jobs.job_card.full_time
    Onsite - Minneapolis, MN / Charlotte, NC / Irving, TX.Competitive and commensurate with experience.Join our dynamic team as a Developer where you'll play a key role in implementing and deploying AP...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Software Engineer, Platform - Minneapolis, USA

    Software Engineer, Platform - Minneapolis, USA

    Speechify • Minneapolis, MN, United States
    serp_jobs.job_card.full_time
    The mission of Speechify is to make sure that reading is never a barrier to learning.Over 50 million people use Speechify's text-to-speech products to turn whatever they're reading - PDFs, books, G...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Sr. Hadoop Architect-Remote

    Sr. Hadoop Architect-Remote

    Staffing the Universe • Minneapolis, MN, United States
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    Location : Minneapolis, MN or Remote.Hadoop Architect to guide the migration of an application in HDP platform to CDP platform. The current installation has 80 nodes.Data size is small, however, the ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Software Engineer I

    Software Engineer I

    Banner Engineering • Minneapolis, MN, United States
    serp_jobs.job_card.full_time
    This is a great opportunity for someone who enjoys working individually or collaboratively, staying on top of tasks, and making a meaningful impact across teams and projects.Below are some key resp...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Cloud Operations Engineer II Neuro

    Cloud Operations Engineer II Neuro

    Medtronic • Minneapolis, Minnesota, USA
    serp_jobs.job_card.full_time
    We anticipate the application window for this opening will close on - 8 Dec 2025.At Medtronic you can begin a life-long career of exploration and innovation while helping champion healthcare access...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Integration Engineer

    Integration Engineer

    Noblesoft Technologies • Edina, Minnesota, USA
    serp_jobs.job_card.full_time
    Job Title : Integration Engineer.JD for Rhapsody & Device Integration : .JD An Integration Engineer with hands on experience on any Integration Engine (Rhapsody IIB Cloverleaf Ensemble Corepoint etc...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted