Code

Executor time duration change#440

Code

Open

hjha1 wants to merge 16 commits intolinkedin:customSHSWorklinkedin/dr-elephant:customSHSWorkfrom hjha1:executorTimeDurationChangehjha1/dr-elephant:executorTimeDurationChangeCopy head branch name to clipboard

+3,428-1,080

Commits

Commits on May 21, 2018

• Spark Executor Spill Heuristic - (Depends on Custom SHS - Requires totalMemoryBytesSpilled metric) (linkedin#310)

  

  skakker

  authored and

  akshayrai

  committed
  55a3f2b

• Spark Stages with Failed tasks Heuristic - (Depends on Custom SHS - Requires stages/failedTasks Rest API) (linkedin#288)

  

  skakker

  authored and

  akshayrai

  committed
  eec5ff7

• Spark Peak jvm memory Heuristic - (Depends on Custom SHS - Requires peakJvmUsedMemory metric) (linkedin#318)

  

  skakker

  authored and

  akshayrai

  committed
  d969e8f

• Peak Unified Memory Heuristic - (Depends on Custom SHS - Requires peakUnifiedMemory metric) (linkedin#281)

  

  skakker

  authored and

  akshayrai

  committed
  834d07c

• Fixed resources used/wasted computation for spark jobs - (Depends on Custom SHS - Requires peakJvmUsedMemory metric) (linkedin#287)

  

  skakker

  authored and

  akshayrai

  committed
  21b1286

• Changing GC thresholds and calculation in spill heuristic (linkedin#319)

  

  skakker

  authored and

  akshayrai

  committed
  c7b84c4

• Spark Heuristic Fixes for Dr. Elephant (linkedin#324)

  Show description for fe8b9c5
  

  skakker

  authored and

  akshayrai

  committed
  fe8b9c5

• Removing blocking keyword so as to prevent a large number of threads being spawned (linkedin#362)

  

  skakker

  authored and

  akshayrai

  committed
  e15343b

Commits on Jul 11, 2018

• Revert "Dr. Elephant Tez Support working patch (linkedin#313)"

  Show description for 8d7b64d
  

  akshayrai

  authored and

  arpang

  committed
  8d7b64d

• Rerevert "Dr. Elephant Tez Support working patch (linkedin#313)" including attribution.

  Show description for d5476c1
  

  2 peopleauthored and

  arpang

  committed
  d5476c1

• Auto tuning: Support for parameter set multi-try (linkedin#386)

  arpang

  committed
  51fe80a

• Merge pull request linkedin#397 from arpang/customSHSWork

  Show description for f785ef3
  skakker

  authored
  f785ef3

Commits on Aug 9, 2018

• Spark heuristic modification (linkedin#407)

  Show description for 17fcb60
  

  ShubhamGupta29

  authored and

  pralabhkumar

  committed
  17fcb60

Commits on Sep 24, 2018

• Total Duration changed to difference of executor add and remover time

  

  Himani Jha

  committed
  0c39177

• Indent changes

  

  Himani Jha

  committed
  e03fcfb

• Update SparkExecutorData.java

  hjha1

  authored
  39793e0