Investigate RDD.sample behavior change in Spark 3 · Issue #3379 · locationtech/geotrellis · GitHub
Skip to content

Investigate RDD.sample behavior change in Spark 3 #3379

Open

Description

@pomadchin

Describe the bug

One of our tests changed its behavior after upgrading up to Spark 3.x.

The original comment is located here #3294 (comment)

This issue is to track down the root cause of the behavior change, explain it and fix if necessary.

To Reproduce

$ ./sbt
$ project spark
$ testOnly geotrellis.spark.summary.StatsTileRDDMethodsSpec -- -z "should be able to sample a fraction of an RDD to compute a histogram"

Activity

  1. added
    dependenciesPull requests that update a dependency file
    and removed
    dependenciesPull requests that update a dependency file
    on Apr 9, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions