Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GraphX merge upstream changes and switched vertex id type to long #1

Open
wants to merge 529 commits into
base: graph
Choose a base branch
from

Conversation

jegonzal
Copy link
Collaborator

@jegonzal jegonzal commented Aug 6, 2013

In this pull request I have:

  1. merged changes from upstream into the graph branch,
  2. added in some old changes I had never committed,
  3. switched to long vertex ids, and
  4. switched to using 2d partitioning.

Unfortunately, I have not had a chance to test these changes extensively so you may want to pull into an alpha branch.

mateiz and others added 30 commits July 19, 2013 13:33
Move ML lib data generator files to util/
Regression: default webui-port can't be set via command line "--webui-port" anymore
Update JavaDoubleRDD to add new methods and docs.

Fixes SPARK-825.
Fix bug: DoubleRDDFunctions.sampleStdev() computed non-sample stdev()
This is used to find methods in the Scala API that
need to be ported to the Java API.  To use it:

  ./run spark.tools.JavaAPICompletenessChecker
Conflicts:
	project/SparkBuild.scala
	run
	run2.cmd
Creates Executors tab for Jobs UI
Add a public method getCachedRdds to SparkContext
Made RegressionModel serializable and added unit tests to make sure predict methods would work.
karenfeng and others added 29 commits August 2, 2013 13:25
adding matrix factorization data generator
SPARK-847 + SPARK-845: Zombie workers and negative cores
SHARK-94 Log the files computed by HadoopRDD and NewHadoopRDD
…g number of changes since the fastutil library function names include the type (e.g., getLong() instead of just get())
jegonzal added a commit that referenced this pull request Oct 7, 2013
Return Graph from Graph.aggregateNeighbors
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.