Hadoop Python Data Engineer
Job Title: Hadoop Data Engineer Location: Chicago, IL/Denver, CO/Washington, DC Work Arrangement: Fully Onsite Client Industry: Enterprise BFSI client Duration: 18 Months Contract Schedule: Monday to Friday, Standard working hours About the Role: Seeking a highly skilled Data Engineer (hadoop plus python) to join the client in Chicago or Denver or Washington. This is a 100% onsite role supporting critical data ingestion, pipeline development, and performance optimization initiatives in a secure banking environment. Top Three skills: Python-Based Data Pipeline Engineering Building production-grade pipelines Performance tuning, memory management, error handling Batch & near-real-time processing Hadoop Ecosystem Expertise Strong understanding of HDFS, YARN, MapReduce Distributed processing with Spark/Hive Scalable and reliable data workflows Custom Data Ingestion & Integration Designing ingestion from APIs, queues, DBs, files Kafka & message-driven architectures PHP-based data services & integration endpoints What We’re Looking For: · Design, develop, and maintain data pipelines primarily using Python, writing production-grade code to ingest, process, and move large-scale datasets across distributed environments. · Build and enhance data processing workflows on Hadoop-based platforms, leveraging a strong understanding of Hadoop architecture (HDFS, YARN, MapReduce) to ensure scalability, reliability, and performance. · Develop custom data ingestion and transformation logic, rather than relying solely on prebuilt tools, to support batch and near-real-time processing requirements. · Write, maintain, and optimize Python code for distributed data processing, including performance tuning, memory management, and error handling in large data environments. · Contribute hands-on code in PHP to support data services, ingestion endpoints, or integration layers that interact with data pipelines or upstream/downstream system Compensation: Hourly Rate: $63 – $64 per hour This range reflects base compensation and may vary based on location, market conditions, experience, and candidate qualifications. Benefits: The Company offers the following benefits for this position, subject to applicable eligibility requirements: medical insurance, dental insurance, vision insurance, 401(k) retirement plan, life insurance, long-term disability insurance, short-term disability insurance, paid parking/public transportation, (paid time , paid sick and safe time , hours of paid vacation time, weeks of paid parental leave, paid holidays annually - AS Applicable) About Us: At Collabera, we don’t just offer jobs—we build careers. As a global leader in talent solutions, we provide opportunities to work with top organizations, cutting-edge technologies, and dynamic teams. Our culture thrives on innovation, collaboration, and a commitment to excellence. With continuous learning, career growth, and a people-first approach, we empower you to achieve your full potential. Join us and be part of a company that values passion, integrity, and making an impact. Ready to Apply? Apply now on [email protected]/973-841-2468 Note: we are looking for python programming with data integration rather than ETL Tooling.