[jira] [Commented] (AVRO-3107) Python API documentation isn't available
[ https://issues.apache.org/jira/browse/AVRO-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17406508#comment-17406508 ] Michael A. Smith commented on AVRO-3107: P.S. should we close this in favor of the ancient AVRO-312? > Python API documentation isn't available > > > Key: AVRO-3107 > URL: https://issues.apache.org/jira/browse/AVRO-3107 > Project: Apache Avro > Issue Type: New Feature > Components: doc, python >Reporter: Spencer Nelson >Priority: Major > > It's entirely possible that I'm missing something, but I can't find > documentation for the Python API. > > It used to exist, long ago; I can find docs for version 1.2.0 and earlier: > * [https://avro.apache.org/docs/1.2.0/api/py/avro.io.html] > * [https://avro.apache.org/docs/1.0.0/api/py/avro.io.html] > But that link pattern stops working for 1.3+. Now there doesn't appear to be > full documentation of the Python API. There's a brief and informal "getting > started guide" > ([https://avro.apache.org/docs/current/gettingstartedpython.html)] but it > isn't very thorough, and doesn't explain which parts of the published modules > are covered by any API stability. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (AVRO-3066) Add support for duration logical type to Python implementation
[
https://issues.apache.org/jira/browse/AVRO-3066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17406505#comment-17406505
]
Michael A. Smith commented on AVRO-3066:
I think we should also consider adding `dateutil` as an optional dependency,
and only supporting `duration` logicaltype if `dateutil` is installed. If it's
not installed, we can still read documents with that type, but they would fall
back to the `fixed size=12` type.
> Add support for duration logical type to Python implementation
> --
>
> Key: AVRO-3066
> URL: https://issues.apache.org/jira/browse/AVRO-3066
> Project: Apache Avro
> Issue Type: New Feature
> Components: python
>Reporter: Spencer Nelson
>Priority: Minor
>
> The duration logical type was added back in \AVRO-739, but it still isn't in
> the Python implementation.
> Because durations encode an integer number of months in addition to days and
> seconds, the standard library's {{datetime.timedelta}} is insufficient for
> representing an Avro duration.
> One option is to return a tuple - the triplet of months, days, and seconds.
> Another option is to use a
> [relativedelta|https://dateutil.readthedocs.io/en/stable/relativedelta.html]
> from the well-known, but third-party, {{dateutil}} library. I would lean
> towards the latter, but I understand the downsides of adding a dependency.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (AVRO-3107) Python API documentation isn't available
[ https://issues.apache.org/jira/browse/AVRO-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17406504#comment-17406504 ] Michael A. Smith commented on AVRO-3107: Is there a good way to get this going with the existing build process for avro docs for other lang/* implementations? I'm not sure how to get started. > Python API documentation isn't available > > > Key: AVRO-3107 > URL: https://issues.apache.org/jira/browse/AVRO-3107 > Project: Apache Avro > Issue Type: New Feature > Components: doc, python >Reporter: Spencer Nelson >Priority: Major > > It's entirely possible that I'm missing something, but I can't find > documentation for the Python API. > > It used to exist, long ago; I can find docs for version 1.2.0 and earlier: > * [https://avro.apache.org/docs/1.2.0/api/py/avro.io.html] > * [https://avro.apache.org/docs/1.0.0/api/py/avro.io.html] > But that link pattern stops working for 1.3+. Now there doesn't appear to be > full documentation of the Python API. There's a brief and informal "getting > started guide" > ([https://avro.apache.org/docs/current/gettingstartedpython.html)] but it > isn't very thorough, and doesn't explain which parts of the published modules > are covered by any API stability. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (AVRO-3162) Update Python CLI Argument Handling
[
https://issues.apache.org/jira/browse/AVRO-3162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael A. Smith resolved AVRO-3162.
Release Note: The Avro Python cli can now be invoked with `python -m avro`,
or, if python-avro is properly installed (such as with `pip install avro`, then
just `avro` on the commandline.
Resolution: Fixed
> Update Python CLI Argument Handling
> ---
>
> Key: AVRO-3162
> URL: https://issues.apache.org/jira/browse/AVRO-3162
> Project: Apache Avro
> Issue Type: Improvement
> Components: python
>Affects Versions: 1.10.2
>Reporter: Michael A. Smith
>Assignee: Michael A. Smith
>Priority: Major
> Labels: pull-request-available
> Time Spent: 20m
> Remaining Estimate: 0h
>
> Avro python has several modules that use commandline arguments via sys.argv
> or the outdated optparse library. I propose to replace all of that using the
> up-to-date argparse library.
> Also, I would like to move scripts/avro into {{avro/__main__.py}}, so that
> python -m avro invokes it directly, and so that all the avro python
> code is in the same directory tree.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (AVRO-3162) Update Python CLI Argument Handling
[
https://issues.apache.org/jira/browse/AVRO-3162?focusedWorklogId=643265=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-643265
]
ASF GitHub Bot logged work on AVRO-3162:
Author: ASF GitHub Bot
Created on: 30/Aug/21 02:34
Start Date: 30/Aug/21 02:34
Worklog Time Spent: 10m
Work Description: kojiromike merged pull request #1270:
URL: https://github.com/apache/avro/pull/1270
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscr...@avro.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 643265)
Time Spent: 20m (was: 10m)
> Update Python CLI Argument Handling
> ---
>
> Key: AVRO-3162
> URL: https://issues.apache.org/jira/browse/AVRO-3162
> Project: Apache Avro
> Issue Type: Improvement
> Components: python
>Affects Versions: 1.10.2
>Reporter: Michael A. Smith
>Assignee: Michael A. Smith
>Priority: Major
> Labels: pull-request-available
> Time Spent: 20m
> Remaining Estimate: 0h
>
> Avro python has several modules that use commandline arguments via sys.argv
> or the outdated optparse library. I propose to replace all of that using the
> up-to-date argparse library.
> Also, I would like to move scripts/avro into {{avro/__main__.py}}, so that
> python -m avro invokes it directly, and so that all the avro python
> code is in the same directory tree.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (AVRO-3162) Update Python CLI Argument Handling
[
https://issues.apache.org/jira/browse/AVRO-3162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17406503#comment-17406503
]
ASF subversion and git services commented on AVRO-3162:
---
Commit e8c61ba4f0051a76d4bf2e2d4391ec92a6e90f4f in avro's branch
refs/heads/master from Michael A. Smith
[ https://gitbox.apache.org/repos/asf?p=avro.git;h=e8c61ba ]
AVRO-3162: Use Argparse to Manage Arguments (#1270)
Improve the python cli, consisting mainly of scripts/avro and avro.tool, by
implementing argparse, and a `__main__.py` module.
- argparse handles arity and type exceptions more fluently at invocation time
than can easily be done with sys.argv.
- argparse handles sub-commands natively, especially in python 3.7 and up.
- `__main__.py` dispatch (along with setuptools `entry_points.console_scripts`
at install time) allows the cli to be invoked with both `python -m avro` and
just `avro` without having an out-of-band `scripts/avro` directory.
- Just in case someone is still using scripts/avro, I've kept that around with
a deprecation warning.
- I added type hints as best I can; however, the avro script has an `eval` call
that we might want to get rid of, some day.
> Update Python CLI Argument Handling
> ---
>
> Key: AVRO-3162
> URL: https://issues.apache.org/jira/browse/AVRO-3162
> Project: Apache Avro
> Issue Type: Improvement
> Components: python
>Affects Versions: 1.10.2
>Reporter: Michael A. Smith
>Assignee: Michael A. Smith
>Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Avro python has several modules that use commandline arguments via sys.argv
> or the outdated optparse library. I propose to replace all of that using the
> up-to-date argparse library.
> Also, I would like to move scripts/avro into {{avro/__main__.py}}, so that
> python -m avro invokes it directly, and so that all the avro python
> code is in the same directory tree.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [avro] kojiromike merged pull request #1270: AVRO-3162: Update Python CLI
kojiromike merged pull request #1270: URL: https://github.com/apache/avro/pull/1270 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@avro.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [avro] dependabot[bot] opened a new pull request #1319: Bump netty-bom from 4.1.66.Final to 4.1.67.Final in /lang/java
dependabot[bot] opened a new pull request #1319: URL: https://github.com/apache/avro/pull/1319 Bumps [netty-bom](https://github.com/netty/netty) from 4.1.66.Final to 4.1.67.Final. Commits https://github.com/netty/netty/commit/b785fa9eedab659b3acd3f7ca3bb60b92bc8b285;>b785fa9 [maven-release-plugin] prepare release netty-4.1.67.Final https://github.com/netty/netty/commit/7903a44a14912bddb893741d31e70c2cf9fae8f7;>7903a44 Revert [maven-release-plugin] prepare release netty-4.1.67.Final https://github.com/netty/netty/commit/ec23189e727a91269ff539aea8080e020c5886ed;>ec23189 Revert [maven-release-plugin] prepare for next development iteration https://github.com/netty/netty/commit/76c55caeb95c2ffb940efae4f4028181adfe96f2;>76c55ca [maven-release-plugin] prepare for next development iteration https://github.com/netty/netty/commit/f773733af68d38086bb90c3a10392c8ae92d811f;>f773733 [maven-release-plugin] prepare release netty-4.1.67.Final https://github.com/netty/netty/commit/056eba4db4c1b466d6b45d261642a6aa6134fe38;>056eba4 server h2c upgrade fail when request doesn't have connection header (https://github-redirect.dependabot.com/netty/netty/issues/11569;>#11569) https://github.com/netty/netty/commit/f750e2eb6a9e8598091abb48c8c806c5ef64b0bd;>f750e2e Add support for client-side TCP FastOpen to KQueue MacOS (https://github-redirect.dependabot.com/netty/netty/issues/11560;>#11560) https://github.com/netty/netty/commit/699549dcbcc4b2de5aaa6e707e157925d20e3791;>699549d Improve test failure reporting of EpollSocketChannelConfigTest (https://github-redirect.dependabot.com/netty/netty/issues/11570;>#11570) https://github.com/netty/netty/commit/beb4588b4a2e93ef88af8466c556363f67e770f7;>beb4588 Inline variables to make code more readable (https://github-redirect.dependabot.com/netty/netty/issues/11565;>#11565) https://github.com/netty/netty/commit/3c27e008b658f2d3f4ba27b6c339a167fe37c93a;>3c27e00 Some small improvements (https://github-redirect.dependabot.com/netty/netty/issues/11564;>#11564) Additional commits viewable in https://github.com/netty/netty/compare/netty-4.1.66.Final...netty-4.1.67.Final;>compare view [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- Dependabot commands and options You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@avro.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [avro] dependabot[bot] opened a new pull request #1318: Bump mocha from 6.2.3 to 9.1.1 in /lang/js
dependabot[bot] opened a new pull request #1318: URL: https://github.com/apache/avro/pull/1318 Bumps [mocha](https://github.com/mochajs/mocha) from 6.2.3 to 9.1.1. Release notes Sourced from https://github.com/mochajs/mocha/releases;>mocha's releases. v9.1.1 9.1.1 / 2021-08-28 Please also note our https://github.com/mochajs/mocha/discussions/categories/announcements;>announcements. :bug: Fixes https://github-redirect.dependabot.com/mochajs/mocha/issues/4623;>#4623: XUNIT and JSON reporter crash in parallel mode (https://github.com/curtisman;>@curtisman) v9.1.0 9.1.0 / 2021-08-20 Please also note our https://github.com/mochajs/mocha/discussions/categories/announcements;>announcements. :tada: Enhancements https://github-redirect.dependabot.com/mochajs/mocha/issues/4716;>#4716: Add new option --fail-zero (https://github.com/juergba;>@juergba) https://github-redirect.dependabot.com/mochajs/mocha/issues/4691;>#4691: Add new option --node-option (https://github.com/juergba;>@juergba) https://github-redirect.dependabot.com/mochajs/mocha/issues/4607;>#4607: Add output option to JSON reporter (https://github.com/dorny;>@dorny) v9.0.3 9.0.3 / 2021-07-25 :bug: Fixes https://github-redirect.dependabot.com/mochajs/mocha/issues/4702;>#4702: Error rethrow from cwd-relative path while loading .mocharc.js (https://github.com/kirill-golovan;>@kirill-golovan) https://github-redirect.dependabot.com/mochajs/mocha/issues/4688;>#4688: Usage of custom interface in parallel mode (https://github.com/juergba;>@juergba) https://github-redirect.dependabot.com/mochajs/mocha/issues/4687;>#4687: ESM: don't swallow MODULE_NOT_FOUND errors in case of type:module (https://github.com/giltayar;>@giltayar) v9.0.2 9.0.2 / 2021-07-03 :bug: Fixes https://github-redirect.dependabot.com/mochajs/mocha/issues/4668;>#4668: ESM: make --require dir work with new import-first loading (https://github.com/giltayar;>@giltayar) :nut_and_bolt: Other https://github-redirect.dependabot.com/mochajs/mocha/issues/4674;>#4674: Update production dependencies (https://github.com/juergba;>@juergba) v9.0.1 9.0.1 / 2021-06-18 :nut_and_bolt: Other https://github-redirect.dependabot.com/mochajs/mocha/issues/4657;>#4657: Browser: add separate bundle for modern browsers (https://github.com/juergba;>@juergba) We added a separate browser bundle mocha-es2018.js in javascript ES2018, as we skipped the transpilation down to ES5. This is an experimental step towards freezing Mocha's support of IE11. ... (truncated) Changelog Sourced from https://github.com/mochajs/mocha/blob/master/CHANGELOG.md;>mocha's changelog. 9.1.1 / 2021-08-28 :bug: Fixes https://github-redirect.dependabot.com/mochajs/mocha/issues/4623;>#4623: XUNIT and JSON reporter crash in parallel mode (https://github.com/curtisman;>@curtisman) 9.1.0 / 2021-08-20 :tada: Enhancements https://github-redirect.dependabot.com/mochajs/mocha/issues/4716;>#4716: Add new option --fail-zero (https://github.com/juergba;>@juergba) https://github-redirect.dependabot.com/mochajs/mocha/issues/4691;>#4691: Add new option --node-option (https://github.com/juergba;>@juergba) https://github-redirect.dependabot.com/mochajs/mocha/issues/4607;>#4607: Add output option to JSON reporter (https://github.com/dorny;>@dorny) 9.0.3 / 2021-07-25 :bug: Fixes https://github-redirect.dependabot.com/mochajs/mocha/issues/4702;>#4702: Error rethrow from cwd-relative path while loading .mocharc.js (https://github.com/kirill-golovan;>@kirill-golovan) https://github-redirect.dependabot.com/mochajs/mocha/issues/4688;>#4688: Usage of custom interface in parallel mode (https://github.com/juergba;>@juergba) https://github-redirect.dependabot.com/mochajs/mocha/issues/4687;>#4687: ESM: don't swallow MODULE_NOT_FOUND errors in case of type:module (https://github.com/giltayar;>@giltayar) 9.0.2 / 2021-07-03 :bug: Fixes https://github-redirect.dependabot.com/mochajs/mocha/issues/4668;>#4668: ESM: make --require dir work with new import-first loading (https://github.com/giltayar;>@giltayar) :nut_and_bolt: Other https://github-redirect.dependabot.com/mochajs/mocha/issues/4674;>#4674: Update production dependencies (https://github.com/juergba;>@juergba) 9.0.1 / 2021-06-18 :nut_and_bolt: Other https://github-redirect.dependabot.com/mochajs/mocha/issues/4657;>#4657: Browser: add separate bundle for modern browsers (https://github.com/juergba;>@juergba) We added a separate browser bundle mocha-es2018.js in javascript ES2018, as we skipped the transpilation down to ES5. This is an experimental step towards freezing Mocha's support of IE11.
[GitHub] [avro] dependabot[bot] closed pull request #1311: Bump mocha from 6.2.3 to 9.1.0 in /lang/js
dependabot[bot] closed pull request #1311: URL: https://github.com/apache/avro/pull/1311 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@avro.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (AVRO-1582) Json serialization of nullable fileds and fields with default values improvement.
[
https://issues.apache.org/jira/browse/AVRO-1582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17406400#comment-17406400
]
Jaya Ananthram commented on AVRO-1582:
--
Same need here!
> Json serialization of nullable fileds and fields with default values
> improvement.
> -
>
> Key: AVRO-1582
> URL: https://issues.apache.org/jira/browse/AVRO-1582
> Project: Apache Avro
> Issue Type: Improvement
> Components: java
>Affects Versions: 1.8.0
>Reporter: Zoltan Farkas
>Priority: Major
> Attachments: AVRO-1582-PATCH
>
>
> Currently serializing a nullable field of type union like:
> "type" : ["null","some type"]
> when serialized as JSON results in:
> "field":{"some type":"value"}
> when it could be:
> "field":"value"
> Also fields that equal the the default value can be omitted from the
> serialized data. This is possible because the reader will have the writer's
> schema and can infer the field values. This reduces the size of the json
> messages.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
