This is an automated email from the ASF dual-hosted git repository.
asf-gitbox-commits pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hop-website.git
The following commit(s) were added to refs/heads/asf-site by this push:
new c333c3388c Website updated to 45a48e9
c333c3388c is described below
commit c333c3388c5638d9e73e2d4e8ca4caee6d8491b1
Author: jenkins <[email protected]>
AuthorDate: Fri Sep 25 06:16:54 2026 +0000
Website updated to 45a48e9
---
manual/next/pipeline/transforms/avro-decode.html | 21 ++++++++++++++++---
manual/next/pipeline/transforms/avro-encode.html | 22 +++++++++++++++++---
.../next/pipeline/transforms/avro-file-input.html | 24 +++++++++++++++++++---
.../next/pipeline/transforms/avro-file-output.html | 4 +++-
4 files changed, 61 insertions(+), 10 deletions(-)
diff --git a/manual/next/pipeline/transforms/avro-decode.html
b/manual/next/pipeline/transforms/avro-decode.html
index ad8eb84687..23be1a90bd 100644
--- a/manual/next/pipeline/transforms/avro-decode.html
+++ b/manual/next/pipeline/transforms/avro-decode.html
@@ -2808,15 +2808,15 @@
Single Threaded
<span class="visually-hidden">supported</span>
</li>
- <li class="engine engine--supported" data-engine="native-spark">
+ <li class="engine engine--unsupported" data-engine="native-spark">
<svg class="engine__mark" width="12" height="12" viewBox="0 0 12 12"
aria-hidden="true" focusable="false">
- <path d="M2 6.4 4.6 9 10 3.2" fill="none" stroke="currentColor"
stroke-width="1.8" stroke-linecap="round" stroke-linejoin="round"/>
+ <path d="M3 3l6 6M9 3l-6 6" fill="none" stroke="currentColor"
stroke-width="1.8" stroke-linecap="round"/>
</svg>
Native Spark
- <span class="visually-hidden">supported</span>
+ <span class="visually-hidden">not supported</span>
</li>
<li class="engine engine--supported" data-engine="beam-spark">
<svg class="engine__mark" width="12" height="12" viewBox="0 0 12 12"
aria-hidden="true" focusable="false">
@@ -2857,6 +2857,21 @@
<div class="paragraph">
<p>The Avro decode transform allows you to decode an Avro field and convert it
to Hop fields.</p>
</div>
+<div class="admonitionblock warning">
+<table>
+<tr>
+<td class="icon">
+<i class="fa icon-warning" title="Warning"></i>
+</td>
+<td class="content">
+<div class="paragraph">
+<p>Avro decode does not run on the native Spark engine.
+It decodes an Avro Record field, and the native Spark engine has no Spark data
type to carry such a field from one transform to the next, so the pipeline is
refused before it starts.</p>
+</div>
+</td>
+</tr>
+</table>
+</div>
</div>
</div>
<div class="sect1">
diff --git a/manual/next/pipeline/transforms/avro-encode.html
b/manual/next/pipeline/transforms/avro-encode.html
index 6f472ac0da..ea5650dfe6 100644
--- a/manual/next/pipeline/transforms/avro-encode.html
+++ b/manual/next/pipeline/transforms/avro-encode.html
@@ -2808,15 +2808,15 @@
Single Threaded
<span class="visually-hidden">supported</span>
</li>
- <li class="engine engine--supported" data-engine="native-spark">
+ <li class="engine engine--unsupported" data-engine="native-spark">
<svg class="engine__mark" width="12" height="12" viewBox="0 0 12 12"
aria-hidden="true" focusable="false">
- <path d="M2 6.4 4.6 9 10 3.2" fill="none" stroke="currentColor"
stroke-width="1.8" stroke-linecap="round" stroke-linejoin="round"/>
+ <path d="M3 3l6 6M9 3l-6 6" fill="none" stroke="currentColor"
stroke-width="1.8" stroke-linecap="round"/>
</svg>
Native Spark
- <span class="visually-hidden">supported</span>
+ <span class="visually-hidden">not supported</span>
</li>
<li class="engine engine--supported" data-engine="beam-spark">
<svg class="engine__mark" width="12" height="12" viewBox="0 0 12 12"
aria-hidden="true" focusable="false">
@@ -2857,6 +2857,22 @@
<div class="paragraph">
<p>The Avro encode transform allows you to encode a new Avro Record field
using a selection of Hop fields. The Avro schema will be part of the value
metadata for this Avro Record field.</p>
</div>
+<div class="admonitionblock warning">
+<table>
+<tr>
+<td class="icon">
+<i class="fa icon-warning" title="Warning"></i>
+</td>
+<td class="content">
+<div class="paragraph">
+<p>Avro encode does not run on the native Spark engine.
+The native Spark engine has no Spark data type to carry the Avro Record field
this transform produces from one transform to the next, so the pipeline is
refused before it starts.
+To write Avro on the native Spark engine, use the <a
href="avro-file-output.html" class="xref page">Avro file output</a>
transform.</p>
+</div>
+</td>
+</tr>
+</table>
+</div>
</div>
</div>
<div class="sect1">
diff --git a/manual/next/pipeline/transforms/avro-file-input.html
b/manual/next/pipeline/transforms/avro-file-input.html
index b1cabd398b..1d2004763a 100644
--- a/manual/next/pipeline/transforms/avro-file-input.html
+++ b/manual/next/pipeline/transforms/avro-file-input.html
@@ -2808,15 +2808,15 @@
Single Threaded
<span class="visually-hidden">supported</span>
</li>
- <li class="engine engine--supported" data-engine="native-spark">
+ <li class="engine engine--unsupported" data-engine="native-spark">
<svg class="engine__mark" width="12" height="12" viewBox="0 0 12 12"
aria-hidden="true" focusable="false">
- <path d="M2 6.4 4.6 9 10 3.2" fill="none" stroke="currentColor"
stroke-width="1.8" stroke-linecap="round" stroke-linejoin="round"/>
+ <path d="M3 3l6 6M9 3l-6 6" fill="none" stroke="currentColor"
stroke-width="1.8" stroke-linecap="round"/>
</svg>
Native Spark
- <span class="visually-hidden">supported</span>
+ <span class="visually-hidden">not supported</span>
</li>
<li class="engine engine--supported" data-engine="beam-spark">
<svg class="engine__mark" width="12" height="12" viewBox="0 0 12 12"
aria-hidden="true" focusable="false">
@@ -2857,6 +2857,24 @@
<div class="paragraph">
<p>The Avro file input transform simply reads Avro records from one or more
files.</p>
</div>
+<div class="admonitionblock warning">
+<table>
+<tr>
+<td class="icon">
+<i class="fa icon-warning" title="Warning"></i>
+</td>
+<td class="content">
+<div class="paragraph">
+<p>Avro file input does not run on the native Spark engine.
+It produces an Avro Record field, and the native Spark engine has no Spark
data type to carry that field from one transform to the next, so the pipeline
is refused before it starts.</p>
+</div>
+<div class="paragraph">
+<p>Run the pipeline that reads the Avro files on the Hop engine or on a Beam
engine instead.</p>
+</div>
+</td>
+</tr>
+</table>
+</div>
<div class="paragraph">
<p>Each record is encapsulated in an Avro field, each value has its own Schema
and record.</p>
</div>
diff --git a/manual/next/pipeline/transforms/avro-file-output.html
b/manual/next/pipeline/transforms/avro-file-output.html
index 328d51cb33..afaca5acc1 100644
--- a/manual/next/pipeline/transforms/avro-file-output.html
+++ b/manual/next/pipeline/transforms/avro-file-output.html
@@ -2913,7 +2913,9 @@ Note: This name has to be unique in a single
pipeline.</p></td>
</tr>
<tr>
<td class="tableblock halign-left valign-top"><p class="tableblock">Schema
filename</p></td>
-<td class="tableblock halign-left valign-top"><p class="tableblock">Filepath
to write or read the schema from.</p></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Filepath
to write or read the schema from.
+The path can contain variables, for example
<code>${PROJECT_HOME}/schemas/customer.avsc</code>, and can point to any file
system Hop supports (local, <code>s3://</code>, <code>azure://</code>,
<code>gs://</code>, …​).
+When <strong>Automatically create schema</strong> is disabled, the transform
reads the schema from this file before it writes the first row, and fails if
the file can’t be read or isn’t a valid Avro schema.</p></td>
</tr>
<tr>
<td class="tableblock halign-left valign-top"><p class="tableblock">Create
parent folder</p></td>
