Commit history

1. Commits on Apr 28, 2021

   • [SPARK-34979][PYTHON][DOC] Add PyArrow installation note for PySpark aarch64 user

     Show description for 0769049
     

     Yikun

     authored and

     HyukjinKwon

     committed
     0769049View commit details

     Copy full SHA for 0769049

     View code at this pointBrowse repository at this point
2. Commits on Apr 27, 2021

   • [SPARK-35150][ML] Accelerate fallback BLAS with dev.ludovic.netlib

     Show description for 5b77ebb
     

     luhenry

     authored and

     srowen

     committed
     5b77ebbView commit details

     Copy full SHA for 5b77ebb

     View code at this pointBrowse repository at this point

   • [MINOR][DOCS][ML] Explicit return type of array_to_vector utility function

     Show description for 592230e
     

     jlafaye

     authored and

     srowen

     committed
     592230eView commit details

     Copy full SHA for 592230e

     View code at this pointBrowse repository at this point
3. Commits on Apr 25, 2021

   • [SPARK-35024][ML] Refactor LinearSVC - support virtual centering

     Show description for 1f150b9
     zhengruifeng

     committed
     1f150b9View commit details

     Copy full SHA for 1f150b9

     View code at this pointBrowse repository at this point
4. Commits on Apr 23, 2021

   • [SPARK-35040][PYTHON] Remove Spark-version related codes from test codes

     Show description for 4fcbf59
     

     xinrong-meng

     authored and

     ueshin

     committed
     4fcbf59View commit details

     Copy full SHA for 4fcbf59

     View code at this pointBrowse repository at this point
5. Commits on Apr 22, 2021

   • [SPARK-34999][PYTHON] Consolidate PySpark testing utils

     Show description for 4d2b559
     

     xinrong-meng

     authored and

     ueshin

     committed
     4d2b559View commit details

     Copy full SHA for 4d2b559

     View code at this pointBrowse repository at this point
6. Commits on Apr 21, 2021

   • [SPARK-35142][PYTHON][ML] Fix incorrect return type for `rawPredictionUDF` in `OneVsRestModel`

     Show description for b6350f5
     

     harupy

     authored and

     WeichenXu123

     committed
     b6350f5View commit details

     Copy full SHA for b6350f5

     View code at this pointBrowse repository at this point
7. Commits on Apr 16, 2021

   • [SPARK-34995] Port/integrate Koalas remaining codes into PySpark

     Show description for 91bd384
     

     itholic

     authored and

     HyukjinKwon

     committed
     91bd384View commit details

     Copy full SHA for 91bd384

     View code at this pointBrowse repository at this point
8. Commits on Apr 15, 2021

   • [SPARK-35032][PYTHON] Port Koalas Index unit tests into PySpark

     Show description for 4aee19e
     

     xinrong-meng

     authored and

     HyukjinKwon

     committed
     4aee19eView commit details

     Copy full SHA for 4aee19e

     View code at this pointBrowse repository at this point

   • Revert "[SPARK-34995] Port/integrate Koalas remaining codes into PySpark"

     Show description for 637f593
     HyukjinKwon

     committed
     637f593View commit details

     Copy full SHA for 637f593

     View code at this pointBrowse repository at this point

   • [SPARK-34995] Port/integrate Koalas remaining codes into PySpark

     Show description for 9689c44
     

     itholic

     authored and

     HyukjinKwon

     committed
     9689c44View commit details

     Copy full SHA for 9689c44

     View code at this pointBrowse repository at this point

   • [SPARK-35071][PYTHON] Rename Koalas to pandas-on-Spark in main codes

     Show description for 7ff9d2e
     HyukjinKwon

     committed
     7ff9d2eView commit details

     Copy full SHA for 7ff9d2e

     View code at this pointBrowse repository at this point

   • [SPARK-35034][PYTHON] Port Koalas miscellaneous unit tests into PySpark

     Show description for 58feb85
     

     xinrong-meng

     authored and

     HyukjinKwon

     committed
     58feb85View commit details

     Copy full SHA for 58feb85

     View code at this pointBrowse repository at this point
9. Commits on Apr 14, 2021

   • [SPARK-34630][PYTHON][FOLLOWUP] Add __version__ into pyspark init __all__

     Show description for 31555f7
     

     Yikun

     authored and

     zero323

     committed
     31555f7View commit details

     Copy full SHA for 31555f7

     View code at this pointBrowse repository at this point

   • [SPARK-35039][PYTHON] Remove PySpark version dependent codes

     Show description for 4ae57d5
     

     ueshin

     authored and

     HyukjinKwon

     committed
     4ae57d5View commit details

     Copy full SHA for 4ae57d5

     View code at this pointBrowse repository at this point

   • [SPARK-35035][PYTHON] Port Koalas internal implementation unit tests into PySpark

     Show description for 47d62af
     

     xinrong-meng

     authored and

     HyukjinKwon

     committed
     47d62afView commit details

     Copy full SHA for 47d62af

     View code at this pointBrowse repository at this point

   • [SPARK-35033][PYTHON] Port Koalas plot unit tests into PySpark

     Show description for cd1e8e8
     

     xinrong-meng

     authored and

     HyukjinKwon

     committed
     cd1e8e8View commit details

     Copy full SHA for cd1e8e8

     View code at this pointBrowse repository at this point

   • [MINOR][PYTHON][DOCS] Fix docstring for pyspark.sql.DataFrameWriter.json lineSep param

     Show description for faa928c
     

     AlexMooney

     authored and

     HyukjinKwon

     committed
     faa928cView commit details

     Copy full SHA for faa928c

     View code at this pointBrowse repository at this point
10. Commits on Apr 13, 2021

    • [SPARK-35012][PYTHON] Port Koalas DataFrame-related unit tests into PySpark

      Show description for 8ebc3fc
      

      xinrong-meng

      authored and

      ueshin

      committed
      8ebc3fcView commit details

      Copy full SHA for 8ebc3fc

      View code at this pointBrowse repository at this point

    • [SPARK-34996][PYTHON] Port Koalas Series-related unit tests into PySpark

      Show description for a392633
      

      xinrong-meng

      authored and

      HyukjinKwon

      committed
      a392633View commit details

      Copy full SHA for a392633

      View code at this pointBrowse repository at this point

    • [SPARK-35031][PYTHON] Port Koalas operations on different frames tests into PySpark

      Show description for 9c1f807
      

      xinrong-meng

      authored and

      HyukjinKwon

      committed
      9c1f807View commit details

      Copy full SHA for 9c1f807

      View code at this pointBrowse repository at this point

    • [SPARK-35019][PYTHON][SQL] Fix type hints mismatches in pyspark.sql.*

      Show description for b43f7e6
      

      Yikun

      authored and

      HyukjinKwon

      committed
      b43f7e6View commit details

      Copy full SHA for b43f7e6

      View code at this pointBrowse repository at this point
11. Commits on Apr 12, 2021

    • [SPARK-34983][PYTHON] Renaming the package alias from pp to ps

      Show description for fd8081c
      

      Luka Sturtewagen

      authored and

      HyukjinKwon

      committed
      fd8081cView commit details

      Copy full SHA for fd8081c

      View code at this pointBrowse repository at this point
12. Commits on Apr 11, 2021

    • [SPARK-34972][PYTHON][TEST][FOLLOWUP] Fix pyspark.pandas doctests which could be flaky

      Show description for ff1fc5e
      

      ueshin

      authored and

      HyukjinKwon

      committed
      ff1fc5eView commit details

      Copy full SHA for ff1fc5e

      View code at this pointBrowse repository at this point

    • [SPARK-34630][PYTHON] Add typehint for pyspark.__version__

      Show description for 4c1ccda
      

      Yikun

      authored and

      HyukjinKwon

      committed
      4c1ccdaView commit details

      Copy full SHA for 4c1ccda

      View code at this pointBrowse repository at this point
13. Commits on Apr 9, 2021

    • [SPARK-34886][PYTHON] Port/integrate Koalas DataFrame unit test into PySpark

      Show description for 3af2c1b
      

      xinrong-meng

      authored and

      HyukjinKwon

      committed
      3af2c1bView commit details

      Copy full SHA for 3af2c1b

      View code at this pointBrowse repository at this point
14. Commits on Apr 7, 2021

    • [SPARK-34972][PYTHON] Make pandas-on-Spark doctests work

      Show description for 2635c38
      

      ueshin

      authored and

      HyukjinKwon

      committed
      2635c38View commit details

      Copy full SHA for 2635c38

      View code at this pointBrowse repository at this point
15. Commits on Apr 6, 2021

    • [SPARK-34968][TEST][PYTHON] Add the `-fr` argument to xargs rm

      Show description for 390d5bd
      

      Yikun

      authored and

      dongjoon-hyun

      committed
      390d5bdView commit details

      Copy full SHA for 390d5bd

      View code at this pointBrowse repository at this point

    • [SPARK-34890][PYTHON] Port/integrate Koalas main codes into PySpark

      Show description for caf04f9
      

      itholic

      authored and

      HyukjinKwon

      committed
      caf04f9View commit details

      Copy full SHA for caf04f9

      View code at this pointBrowse repository at this point
16. Commits on Apr 4, 2021

    • [MINOR][DOCS] Use ASCII characters when possible in PySpark documentation

      Show description for 2ca76a5
      

      HyukjinKwon

      authored and

      MaxGekk

      committed
      2ca76a5View commit details

      Copy full SHA for 2ca76a5

      View code at this pointBrowse repository at this point
17. Commits on Mar 30, 2021

    • [SPARK-34463][PYSPARK][DOCS] Document caveats of Arrow selfDestruct

      Show description for 1237124
      

      lidavidm

      authored and

      HyukjinKwon

      committed
      1237124View commit details

      Copy full SHA for 1237124

      View code at this pointBrowse repository at this point
18. Commits on Mar 29, 2021

    • [SPARK-34872][SQL] quoteIfNeeded should quote a name which contains non-word characters

      Show description for 14c7bb8
      

      sarutak

      authored and

      cloud-fan

      committed
      14c7bb8View commit details

      Copy full SHA for 14c7bb8

      View code at this pointBrowse repository at this point
19. Commits on Mar 24, 2021

    • [SPARK-34630][PYTHON][SQL] Added typehint for pyspark.sql.Column.contains

      Show description for ad211cc
      

      dannymeijer

      authored and

      zero323

      committed
      ad211ccView commit details

      Copy full SHA for ad211cc

      View code at this pointBrowse repository at this point
20. Commits on Mar 22, 2021

    • [SPARK-34803][PYSPARK] Pass the raised ImportError if pandas or pyarrow fail to import

      Show description for ddfc75e
      

      johnhany97

      and

      HyukjinKwon

      committed
      ddfc75eView commit details

      Copy full SHA for ddfc75e

      View code at this pointBrowse repository at this point

    • [SPARK-34818][PYTHON][DOCS] Reorder the items in User Guide at PySpark documentation

      Show description for c7bf8ad
      HyukjinKwon

      committed
      c7bf8adView commit details

      Copy full SHA for c7bf8ad

      View code at this pointBrowse repository at this point