Big Data Engineer

Company Details

(C.N) is a recognized organization that strives to maintain an inclusive workplace culture while delivering clients with services of elevated and uplifted caliber. It also fosters creativity and productivity with a commitment to quality.

The team of big data engineers are passionate architects who work in front and behind infrastructure scenes related to data empowering other organizations by harnessing the potential of data. Their role will be pivotal in transforming raw data into actionable essences that can lead to productive growth and standard growth.

Job Description

We are seeking a skilled and experienced big data engineer to join our dynamic team who will be responsible for designing, implementing, and maintaining our company's data infrastructure and tools.

The candidate will be crafting data-related pipelines storing vast data from myriad sources. Whether it's about structured transactional data or unstructured social media data everything is considered by big data engineers.

Their work will directly impact the ability of data scientists and analysts to derive meaningful insights from the data. By implementing cutting-edge data processing frameworks and algorithms, candidates will be empowered to uncover hidden patterns, trends, and correlations that drive innovation and competitive advantage. The candidate's contributions willtruly be sufficient in bridging the gap between raw data and actionable intelligence, enabling informed decision-making at every level of the organization.

The candidate will be actively collaborating and connecting with cross-functional teams, understanding third requirements, and translating into scalable solutions. Their ability to communicate complex technical concepts clearly and concisely should foster alignment, collaboration, and driving force toward common goals and objectives.

Overall the candidate will be upholding crucial responsibilities from architecting robust data infrastructure to optimizing performance and insights.

Responsibilities

• The candidate should be responsible for designing, crafting, and implementing scalable data solutions meeting company data processing needs
• Developing data records storing large volumes from diverse sources
• Managing and optimizing data storage systems and analytics problems
• The candidate should be highly responsible for evaluation, modifications, and analysis mentorship across teams
• Documenting Design decisions, along with maintaining consistency within projects
• Conducting code reviews, performance evaluations, and quality assessments is also handled by big data engineers.
• The candidate should be enough aware of choosing appropriate tools, technologies, and frameworks supporting big data processing and analysis.

Education

• Should have a Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

Required Skills & Experience

• Prior experience in designing, implementing, and managing Big Data solutions in a production environment.
• Should be highly proficient in programming languages including Java, Python, or Scala, with a strong understanding of data structures, algorithms, and other software engineering principles.
• Should have a strong sense of responsibility and Hands-on experience with Big Data technologies and frameworks, including Hadoop, Spark, Kafka, Hive, HBase, and others.
• Should possess a Solid understanding of distributed computing principles, parallel processing, and large-scale data processing techniques.
• Should be Experienced with cloud platforms such as AWS, Azure, or Google Cloud Platform, and familiarity with related services for data storage, processing, and analytics.
• The candidate should have Strong analytical and problem-solving skills, with the proficiency to troubleshoot complex issues and optimize performance in distributed systems.
• The candidate should have a Proven track record of delivering high-quality solutions on time and within budget, with a focus on scalability, reliability, and performance.
• The candidate should be Certified in Big Data technologies (e.g., Cloudera, Hortonworks, Databricks) is a plus.