what is window function in spark-sql ?
Sr Data Engineer Interview Questions
2,590 sr data engineer interview questions shared by candidates
Spark internal functioning, Data formats
I got a take home assignment to build SPARK application on recipes dataset. The problem was easy but the expectations on the solution was very high. The code should be object-oriented, with config files, unit test cases, logging and alerting, exception handling. Extra points for CI/CD , etc
General questions regarding your career up to now, along with some (general again) IT questions. Perhaps, they are competent enough to infer your knowledge without being too specific. In any case be prepared to go through your whole CV.
They asked me about my experience as a data engineer. And other random HR questions like - strengths and weakness, team expectations, working under pressure etc.,
How do you optimize and check SQL queries
Average questions mostly on SQL, 1 question on data structure. In depth explanation of your current and recent projects. Another interview was based on architecture solutions for certain scenarios.
RDD, hadoop, hdfs, spark, partition
Technical questions regarding the different technology
The Python technical challenge was about ingesting some data in a specific way and do some analytics on the results. The questions were about the reasons behind each decision. Also, they asked for alternatives to the simple provided solution (it was a challenge done in 3h) more oriented to a production-ready environment.
Viewing 2581 - 2590 interview questions
See Interview Questions for Similar Jobs
Data EngineeringSenior Data EngineerBig Data EngineerSenior Big Data EngineerData EngineerSenior Data ConsultantLead Data EngineerData ScientistsData Scientist IiiPrincipal Data EngineerData Mining EngineerBigdata EngineerSr Data AnalystEtl Data Stage DeveloperSr Database EngineerDatabase Administrator IiSenior Data Stage DeveloperEtl Informatica Developer