Job Description:

We are seeking a skilled and experienced freelance Big Data Engineer/Consultant to join our team and contribute to our data processing and analytics projects. The ideal candidate should have expertise in Spark, Spark Streaming, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Snowflake, and Power BI. As a freelance professional, you will be responsible for collaborating with our team, understanding project requirements, and delivering high-quality solutions within specified timelines.

Responsibilities:

1. Data Processing and Analysis:

1. Utilize Spark and Spark Streaming to process and analyze large datasets efficiently.
2. Design and implement scalable and robust data processing pipelines.

2. Azure Data Platform Expertise:

1. Work with Azure Data Factory (ADF) to orchestrate and automate data workflows.
2. Manage and optimize data storage using Azure Data Lake Storage (ADLS).

3. Snowflake Data Warehousing:

1. Develop and maintain data warehouses using Snowflake.
2. Ensure optimal performance and scalability of Snowflake data structures.

4. Business Intelligence (BI) with Power BI:

1. Create visually appealing and insightful reports and dashboards using Power BI.
2. Collaborate with stakeholders to understand reporting requirements and deliver effective BI solutions.

Requirements:

1. Technical Skills:

1. Proficient in Spark and Spark Streaming for big data processing.
2. Hands-on experience with Azure Data Factory (ADF) and Azure Data Lake Storage (ADLS).
3. In-depth knowledge of Snowflake for data warehousing.
4. Expertise in developing interactive reports and dashboards using Power BI.

2. Problem Solving and Analytical Skills:

1. Ability to analyze complex data scenarios and design effective solutions.
2. Strong problem-solving skills with attention to detail.

3. Communication and Collaboration:

1. Excellent communication skills to interact with both technical and non-technical stakeholders.
2. Ability to work collaboratively in a team environment.

4. Time Management:

1. Proven ability to manage multiple tasks and projects simultaneously.
2. Meet project deadlines and deliver high-quality results.

Qualifications:

- Bachelor's or Master’s degree in Computer Science, Information Technology, or a related field. - Proven experience as a Big Data Engineer or Consultant with a focus on Spark, ADF, ADLS, Snowflake, and Power BI.

How to Apply:

Interested candidates should submit their resume, a portfolio of relevant projects, and a brief cover letter outlining their experience and suitability for the role. Please include hourly or project-based rate expectations. Send to khawar@atrc.net.pk with the subject line “Developer resource Dec 2023.”

Note: This is a freelance position, and remote work is acceptable. The selected candidate will work on a project basis with flexible hours to accommodate different time zones.