HyukjinKwon commented on code in PR #46833:
URL: https://github.com/apache/spark/pull/46833#discussion_r1623705416
##########
python/docs/source/user_guide/sql/python_data_source.rst:
##########
@@ -109,6 +112,42 @@ Define the reader logic to generate synthetic data. Use
the `faker` library to p
row.append(value)
yield tuple(row)
+**Implement the Writer**
+
+Create a fake data source writer that processes each partition of data, counts
the rows, and either
+prints the total count of rows after a successful write or the number of
failed tasks if the writing process fails.
+
+.. code-block:: python
+
+ from dataclasses import dataclass
+ from typing import Iterator, List
Review Comment:
```suggestion
from typing import Iterator, List
```
per PEP 8
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
