Apache Spark Interview Questions

Saghir Hussain 12:11

  1. Spark Architecture
  2. Client mode vs Cluster mode
  3. RDD vs Dataframe vs Dataset
  4. SparkContext vs SparkSession
  5. map() vs flatmap()
  6. reduce() vs reduceByKey()
  7. Performance Techniques
  8. Repartition vs Colesece
  9. Order By vs Sort By
  10. Persist vs Cache
  11. Skewness and Salting
  12. Map side Join
  13. Spark configuration for joining two large tables
  14. map() vs mapPartitions()
  15. Broadcast and Accumuator variables
  16. What is lineage and DAG?
  17. Relation between driver, executor, memory, cores, partitions, stage, job, task using example


Tags:

Post a Comment

14 Comments

  1. Anonymous24 June 2021 at 08:31

    https://github.com/gjeevanm/SparkDataSkewness/blob/master/src/main/scala/com/gjeevan/DataSkew/RemoveDataSkew.scala

    ReplyDelete
  2. Saghir Hussain25 June 2021 at 05:32

    https://www.linkedin.com/posts/gauravpatil95_thinkhadoop-hive-spark-activity-6813879213045665792-xQ37

    ReplyDelete
  3. Saghir Hussain28 June 2021 at 18:36

    https://dzone.com/articles/dynamic-partition-pruning-in-spark-30

    ReplyDelete
  4. Saghir Hussain1 July 2021 at 10:05

    https://www.linkedin.com/feed/update/urn:li:activity:6816216259940663296

    ReplyDelete
  5. Anonymous3 July 2021 at 09:41

    https://www.linkedin.com/posts/aparup-chatterjee_apache-spark-30-dpp-activity-6816719664182366208-i6bV

    ReplyDelete
  6. Anonymous7 July 2021 at 20:33

    https://github.com/ankurchavda/SparkLearning

    ReplyDelete
  7. Anonymous11 July 2021 at 06:56

    https://www.java-success.com/spark-interview-qas-with-coding-examples-in-scala-part-1/

    ReplyDelete
  8. Anonymous16 July 2021 at 08:47

    https://www.linkedin.com/posts/yusuf-didighar-64922a166_spark-join-internals-activity-6821458775623507968-2Zjz

    ReplyDelete
  9. Anonymous17 July 2021 at 19:22

    https://stackoverflow.com/questions/32356143/what-does-setmaster-local-mean-in-spark

    ReplyDelete
  10. Anonymous25 July 2021 at 07:14

    https://medium.com/@deepa.account/spark-udfs-and-its-deterministic-nature-b69e3dfc020e

    ReplyDelete
  11. Anonymous25 July 2021 at 07:36

    https://luminousmen.com/post/hadoop-yarn-spark

    ReplyDelete
  12. Anonymous28 July 2021 at 09:29

    https://www.linkedin.com/posts/mayank-ahuja-4b3a23105_kafka-schema-activity-6825815707146575873-h3Vj

    ReplyDelete
  13. Anonymous2 August 2021 at 09:56

    https://www.analyticsvidhya.com/blog/2020/11/8-must-know-spark-optimization-tips-for-data-engineering-beginners/

    ReplyDelete
  14. Venu23 September 2021 at 18:33

    I am giving spark training in Hyderabad, thanks to share valuable spark interview questions to learn spark in Hyderabad . . If you share answers also its really helpful

    ReplyDelete