Trung Tran
Data Engineer
I am proficient in the following technologies and tools:
About me
I am a highly motivated and enthusiastic Data Engineering with a strong passion for leveraging technology to drive data-driven solutions. With a comprehensive skill set and proficiency in tools such as Python, SQL, Azure and Spark. I focus on creating efficient data pipelines, ingesting, transforming and visualizing data to unlock its full potential.
Experience
7-Eleven | Sep 2024 - Present
- Fresher Data Engineer
- Collaborate with cross-functional teams to address and fulfill their data requirements.
- Develop and maintain real-time streaming pipelines that consume data from Kafka and transform it into ClickHouse.
- Design and implement Airflow jobs to process large datasets in batch, including automated notifications to Google Chat for job errors, missing data, or inactive Kafka consumer groups.
- Utilize App Script and n8n to integrate with external services such as Google, Jira for seamless data flow and automation.
- Developed a chatbot for generating insights from Superset data using OpenAI API.
- Enabled real-time replication from PostgreSQL using logical replication and Airbyte CDC.
TC Data | Jun 2024 - Sep 2024
- Trainee Data Engineer
- Developmodules using SQL Server to help stakeholders meet their data needs.
- Engageindiscussions with stakeholders to thoroughly verify and understand the issues present in the data.
Inter-K JSC | Nov 2023 - Jan 2024
- Data Engineer Intern
- Converted approximately 100 SAP crystal reports into paginated reports using PowerBI Report Builder.
- Provided guidance to counterparts on the utilization of the PowerBI Report Builder.