[SPARK-6070] [yarn] Remove unneeded classes from shuffle service jar.

[vanzin]

These may conflict with the classes already in the NM. We shouldn't
be repackaging them.

[vanzin]

I re-generated the jar with this patch and verified there are no "org.apache.hadoop" classes in it.

[vanzin]

Also, an alternative solution would be to force the "hadoop-provided" profile to always be on in this module. Should have the same end result.

[SparkQA]

Test build #28097 has started for PR 4820 at commit 7a18a1b.

• This patch merges cleanly.

[pwendell]

Thanks for finding this! Either approach seems fine to me. This LGTM... it might be nice to add a comment explaining that this is needed because the root pom is declaring them at compile scope.

[SparkQA]

Test build #28099 has started for PR 4820 at commit 3cba946.

• This patch merges cleanly.

[vanzin]

I updated the diff with the profile approach since it doesn't requiring looking for what dependencies have their scope overridden, and seems cleaner overall.

[vanzin]

Actually, d'oh, there might be an even easier fix. Hang on.

[SparkQA]

Test build #28100 has started for PR 4820 at commit 871b566.

• This patch merges cleanly.

[pwendell]

Cool LGTM

[SparkQA]

Test build #28097 has finished for PR 4820 at commit 7a18a1b.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[AmplabJenkins]

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28097/
Test PASSed.

[SparkQA]

Test build #28099 has finished for PR 4820 at commit 3cba946.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds the following public classes (experimental):
  • logError("User class threw exception: " + cause.getMessage, cause)

[AmplabJenkins]

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28099/
Test PASSed.

[SparkQA]

Test build #28100 has finished for PR 4820 at commit 871b566.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[AmplabJenkins]

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28100/
Test PASSed.

[pwendell]

Thanks Marcelo, pulling this in!