

The **`df.write.csv()` method** is used to write a DataFrame to a CSV file. Various different options related to the write operation can be specified via the `df.write.option()` method.

## Syntax

```
df.write.option("option_name", "option_value").csv(file_path)
```

## Parameter

- `file_path`: Denotes the path where the csv file to be created.

## Example

import pyspark, os
from pyspark.sql import SparkSession

spark = SparkSession.builder.appName('answer').getOrCreate()

data = [("James","Educative","Engg","USA"),
    ("Michael","Google",None,"Asia"),
    ("Robert",None,"Marketing","Russia"),
    ("Maria","Netflix","Finance","Ukraine"),
    (None, None, None, None)
  ]

columns = ["emp name","company","department","country"]
df = spark.createDataFrame(data = data, schema = columns)

csv_file_path = "data.csv"
df.write.option("header", True).option("delimiter",",").csv(csv_file_path)


import React from 'react';
import { shallow, configure } from 'enzyme';
import Adapter from 'enzyme-adapter-react-16';

configure({ adapter: new Adapter() });

import HelloWorld from './app';

var TestResult = function() {
    this.succeeded = false;
    this.reason = "";
    this.input = "";
    this.expected_output = "";
    this.actual_output = "";
}

export const executeTests = function() {

  var results = [];

  result = new TestResult();
  result.input = 'HelloWorld Component';
  result.expected_output = "span containing text 'Hello World'"

  let wrapper = shallow(<HelloWorld />);

  // Call your Challenge function here.

  let type = wrapper.type();
  let testSuccessful = true;
  let failureReason;

  if (type !== 'span') {
    testSuccessful = false;
    failureReason = "You need to render exactly one span HTML element";
  } else if (wrapper.props().children != "Hello World") {
     testSuccessful = false;
     failureReason = "You have rendered wrong message in your span element";
  }

  result.actual_output = wrapper.html();

  if (testSuccessful) {
    result.succeeded = true;
    result.reason = "Succeeded"
  } else {
    result.succeeded = false;
    result.reason = failureReason;
  }

  results.push(result);

  return results;
}


pyspark

React

Dart

GoJS React

Typescript React

Vue.js


## Explanation

- **Lines 1–2:** The `pyspark` DataFrame and `SparkSession` is imported.
- **Line 4:** We create a `SparkSession` with the application name `answer`.
- **Lines 6–11:** We define the dummy data for the DataFrame.
- **Line 13:** We define the columns for the dummy data.
- **Line 14:** We create a spark DataFrame with the dummy data defined above.
- **Line 16:** The CSV file path where the CSV file to be generated is defined.
- **Line 17:** The DataFrame is written to a CSV file by invoking the `write.csv()` function on the DataFrame object.

pyspark.tar.gz

How to save a PySpark DataFrame to a CSV file

The df.write.csv() method saves PySpark DataFrames to CSV files, allowing option customization.