Skip to content
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion pandas-on-spark/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -191,4 +191,4 @@ pandas on Spark uses syntax that’s familiar to pandas users, so it’s easy to

pandas on Spark is also a great technology to be used in conjunction with pandas. You can use the big-data and performant processing capabilities of pandas on Spark to process datasets before they’re converted into pandas DataFrames that are compatible with other technologies.

Check out [the docs](https://spark.apache.org/docs/latest/api/python/user_guide/pandas_on_spark/index.html) to learn more about how to use pandas on Spark.
Check out [the docs](https://spark.apache.org/docs/latest/api/python/reference/pyspark.pandas/index.html) to learn more about how to use pandas on Spark.
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@
<script crossorigin="anonymous" integrity="sha256-Ae2Vz/4ePdIu6ZyI/5ZGsYnb+m0JlOmKPjt6XZ9JJkA=" src="https://cdnjs.cloudflare.com/ajax/libs/require.js/2.3.4/require.min.js"></script>
<script async="async" src="https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.5/latest.js?config=TeX-AMS-MML_HTMLorMML"></script>
<script type="text/x-mathjax-config">MathJax.Hub.Config({"tex2jax": {"inlineMath": [["$", "$"], ["\\(", "\\)"]], "processEscapes": true, "ignoreClass": "document", "processClass": "math|output_area"}})</script>
<link rel="canonical" href="https://spark.apache.org/docs/latest/api/python/user_guide/pandas_on_spark/index.html" />
<link rel="canonical" href="https://spark.apache.org/docs/latest/api/python/reference/pyspark.pandas/index.html" />
<link rel="search" title="Search" href="../../search.html" />
<link rel="next" title="Options and settings" href="options.html" />
<link rel="prev" title="Python User-defined Table Functions (UDTFs)" href="../sql/python_udtf.html" />
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -39,7 +39,7 @@
<script crossorigin="anonymous" integrity="sha256-Ae2Vz/4ePdIu6ZyI/5ZGsYnb+m0JlOmKPjt6XZ9JJkA=" src="https://cdnjs.cloudflare.com/ajax/libs/require.js/2.3.4/require.min.js"></script>
<script async="async" src="https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.5/latest.js?config=TeX-AMS-MML_HTMLorMML"></script>
<script type="text/x-mathjax-config">MathJax.Hub.Config({"tex2jax": {"inlineMath": [["$", "$"], ["\\(", "\\)"]], "processEscapes": true, "ignoreClass": "tex2jax_ignore|mathjax_ignore|document", "processClass": "tex2jax_process|mathjax_process|math|output_area"}})</script>
<link rel="canonical" href="https://spark.apache.org/docs/latest/api/python/user_guide/pandas_on_spark/index.html" />
<link rel="canonical" href="https://spark.apache.org/docs/latest/api/python/reference/pyspark.pandas/index.html" />
<link rel="search" title="Search" href="../../search.html" />
<link rel="next" title="Options and settings" href="options.html" />
<link rel="prev" title="Python User-defined Table Functions (UDTFs)" href="../sql/python_udtf.html" />
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@
<script crossorigin="anonymous" integrity="sha256-Ae2Vz/4ePdIu6ZyI/5ZGsYnb+m0JlOmKPjt6XZ9JJkA=" src="https://cdnjs.cloudflare.com/ajax/libs/require.js/2.3.4/require.min.js"></script>
<script async="async" src="https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.5/latest.js?config=TeX-AMS-MML_HTMLorMML"></script>
<script type="text/x-mathjax-config">MathJax.Hub.Config({"tex2jax": {"inlineMath": [["$", "$"], ["\\(", "\\)"]], "processEscapes": true, "ignoreClass": "document", "processClass": "math|output_area"}})</script>
<link rel="canonical" href="https://spark.apache.org/docs/latest/api/python/user_guide/pandas_on_spark/index.html" />
<link rel="canonical" href="https://spark.apache.org/docs/latest/api/python/reference/pyspark.pandas/index.html" />
<link rel="search" title="Search" href="../../search.html" />
<link rel="next" title="Options and settings" href="options.html" />
<link rel="prev" title="Python User-defined Table Functions (UDTFs)" href="../sql/python_udtf.html" />
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@
<script crossorigin="anonymous" integrity="sha256-Ae2Vz/4ePdIu6ZyI/5ZGsYnb+m0JlOmKPjt6XZ9JJkA=" src="https://cdnjs.cloudflare.com/ajax/libs/require.js/2.3.4/require.min.js"></script>
<script async="async" src="https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.5/latest.js?config=TeX-AMS-MML_HTMLorMML"></script>
<script type="text/x-mathjax-config">MathJax.Hub.Config({"tex2jax": {"inlineMath": [["$", "$"], ["\\(", "\\)"]], "processEscapes": true, "ignoreClass": "document", "processClass": "math|output_area"}})</script>
<link rel="canonical" href="https://spark.apache.org/docs/latest/api/python/user_guide/pandas_on_spark/index.html" />
<link rel="canonical" href="https://spark.apache.org/docs/latest/api/python/reference/pyspark.pandas/index.html" />
<link rel="search" title="Search" href="../../search.html" />
<link rel="next" title="Options and settings" href="options.html" />
<link rel="prev" title="Python User-defined Table Functions (UDTFs)" href="../sql/python_udtf.html" />
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@
<script crossorigin="anonymous" integrity="sha256-Ae2Vz/4ePdIu6ZyI/5ZGsYnb+m0JlOmKPjt6XZ9JJkA=" src="https://cdnjs.cloudflare.com/ajax/libs/require.js/2.3.4/require.min.js"></script>
<script async="async" src="https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.5/latest.js?config=TeX-AMS-MML_HTMLorMML"></script>
<script type="text/x-mathjax-config">MathJax.Hub.Config({"tex2jax": {"inlineMath": [["$", "$"], ["\\(", "\\)"]], "processEscapes": true, "ignoreClass": "document", "processClass": "math|output_area"}})</script>
<link rel="canonical" href="https://spark.apache.org/docs/latest/api/python/user_guide/pandas_on_spark/index.html" />
<link rel="canonical" href="https://spark.apache.org/docs/latest/api/python/reference/pyspark.pandas/index.html" />
<link rel="search" title="Search" href="../../search.html" />
<link rel="next" title="Options and settings" href="options.html" />
<link rel="prev" title="Python User-defined Table Functions (UDTFs)" href="../sql/python_udtf.html" />
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@
<script crossorigin="anonymous" integrity="sha256-Ae2Vz/4ePdIu6ZyI/5ZGsYnb+m0JlOmKPjt6XZ9JJkA=" src="https://cdnjs.cloudflare.com/ajax/libs/require.js/2.3.4/require.min.js"></script>
<script async="async" src="https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.5/latest.js?config=TeX-AMS-MML_HTMLorMML"></script>
<script type="text/x-mathjax-config">MathJax.Hub.Config({"tex2jax": {"inlineMath": [["$", "$"], ["\\(", "\\)"]], "processEscapes": true, "ignoreClass": "document", "processClass": "math|output_area"}})</script>
<link rel="canonical" href="https://spark.apache.org/docs/latest/api/python/user_guide/pandas_on_spark/index.html" />
<link rel="canonical" href="https://spark.apache.org/docs/latest/api/python/reference/pyspark.pandas/index.html" />
<link rel="search" title="Search" href="../../search.html" />
<link rel="next" title="Options and settings" href="options.html" />
<link rel="prev" title="Python User-defined Table Functions (UDTFs)" href="../sql/python_udtf.html" />
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@
<script crossorigin="anonymous" integrity="sha256-Ae2Vz/4ePdIu6ZyI/5ZGsYnb+m0JlOmKPjt6XZ9JJkA=" src="https://cdnjs.cloudflare.com/ajax/libs/require.js/2.3.4/require.min.js"></script>
<script async="async" src="https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.5/latest.js?config=TeX-AMS-MML_HTMLorMML"></script>
<script type="text/x-mathjax-config">MathJax.Hub.Config({"tex2jax": {"inlineMath": [["$", "$"], ["\\(", "\\)"]], "processEscapes": true, "ignoreClass": "document", "processClass": "math|output_area"}})</script>
<link rel="canonical" href="https://spark.apache.org/docs/latest/api/python/user_guide/pandas_on_spark/index.html" />
<link rel="canonical" href="https://spark.apache.org/docs/latest/api/python/reference/pyspark.pandas/index.html" />
<link rel="search" title="Search" href="../../search.html" />
<link rel="next" title="Options and settings" href="options.html" />
<link rel="prev" title="Python User-defined Table Functions (UDTFs)" href="../sql/python_udtf.html" />
Expand Down
2 changes: 1 addition & 1 deletion site/pandas-on-spark/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -343,7 +343,7 @@ <h2 id="conclusion">Conclusion</h2>

<p>pandas on Spark is also a great technology to be used in conjunction with pandas. You can use the big-data and performant processing capabilities of pandas on Spark to process datasets before they’re converted into pandas DataFrames that are compatible with other technologies.</p>

<p>Check out <a href="https://spark.apache.org/docs/latest/api/python/user_guide/pandas_on_spark/index.html">the docs</a> to learn more about how to use pandas on Spark.</p>
<p>Check out <a href="https://spark.apache.org/docs/latest/api/python/reference/pyspark.pandas/index.html">the docs</a> to learn more about how to use pandas on Spark.</p>

</div>
<div class="col-12 col-md-3">
Expand Down