Design an ETL solution using Go that would upload CSV files from the directory to Postgres database. Functionality should include: - listing CSV files status (are files already uploaded?) - manual upload from provided CSV file to db - real-time syncing (if file arrived to the folder, and not uploaded yet - ingest data to db)
What is the difference between normalized and de-normalized tables?
Signed confidentiality agreement not to convey technical interview information
You are tasked with designing a customer portal, how do you tackle it. What questions do you ask? How do you flush out your design?
What are your experiences in data engineering?
Tell me about yourself ?
Last interview consisted of a case study that was supposed to showcase something I did in the past or I could also pick a task predefined by them.
Oh, you code in SQL? I sent you a link. CODE SQL OR ELSE!!!!!
Round 2 Interview Topics Python Basic concepts such as generators and iterators. Sorting a list without using built-in functions. SQL Fundamental SQL queries. Analytical operations using window functions and data deduplication. PySpark Optimization techniques. Operations with window functions, grouping, filtering, and exploding data. System Design Questions Provide a detailed explanation of one of your projects, including end-to-end (ETE) project design. How the ETL process flow works?. Describe how you would develop an anomaly detection algorithm and an alerting mechanism.
SQL based leetcode easy questions
Viewing 2021 - 2030 interview questions