[GNC] Finance-Quote 1.61 released!
New version 1.61 of Finance-Quote is available with the following changes: * SIX.pm - Changed lookup for currency, added lookups for symbol and last. Issue #380 * YahooJSON.pm - URLs to retrieve required cookies and crumbs were changed to allow EU based users to use the module. Issue #373 Authors: - Erik Colson - Paul Fenwick - Bruce Schuck - Vincent Lucarelli - David Hampton - jvolkening - Pawel Konieczny - Mike Alexander - AndreJ - Vinay S Shastry - Bradley Dean - Brent Neal - Jacinta Richardson - e-dorigatti - goodvibes2 - Paul Howarth - Sam Morris - Linas Vepstas - Hiranya Samarasekera - Manuel Friedli - Achim Winkler - Diego Marcolungo - John Haiducek - Rajan Vaswani <111571283+bgr22...@users.noreply.github.com> - alex314159 - gregor herrmann - Jalon Avens - Sigve Indregard - bgr22112 <111571283+bgr22...@users.noreply.github.com> - goodvibes2 - Ben Hemming - Caleb Begly - CleanShed <72849657+cleans...@users.noreply.github.com> - Eelco Dolstra - Emmanuel Di Pretoro - Florian Schlichting - Gabor Szabo - GitGord <46006740+gitg...@users.noreply.github.com> - Gustavo R. Montesino - Henrik Ahlgren - Jean-Marie Pacquet - Joseph Heron - Lance Wicks - Liviu Tinta - Martin Kompf - Pete Ratzlaff - Ross Peachey - Stephan Ebelt - Stephan Gambke - linas - thinus - x42x64 ___ gnucash-user mailing list gnucash-user@gnucash.org To update your subscription preferences or to unsubscribe: https://lists.gnucash.org/mailman/listinfo/gnucash-user - Please remember to CC this list on all your replies. You can do this by using Reply-To-List or Reply-All.
Re: [GNC] GNC] Finance-Quote 1.60 released!
I was able to reproduce the issue in Frankfurt so it definitely is "geo" based issue; specifically EU countries. Attached is a drop in replacement YahooJSON.pm module that works with EU and other regions if anyone wants to use it before new package is released that incorporates these changes. -Original Message- From: Bruce Schuck Sent: Thursday, April 18, 2024 1:31 PM To: gnucash-user@gnucash.org Cc: kalpesh.pa...@usa.net Subject: Re: GNC] Finance-Quote 1.60 released! On Thu, 18 Apr 2024 16:13:34 +0200, Klaus writes: > I am located in Germany and only one cookie is returned. Here is the > top of the output of 'curl --include https://login.yahoo.com': Klaus, Thank you for posting that. It helps confirm this is a geo related issue. Thank you to David Crowe for pointing out https://developer.yahooinc.com/datax/guide/gdpr/cookiemapping/ on https://github.com/finance-quote/finance-quote/issues/373. I suspect GDPR compliance is related to the YahooJSON issue. Additional testing did indicate that the module does work from an Albanian IP address. I guess while this is being researched, users with EU IP addresses can not use the 'yahoo_json' quote method. I believe Kalpesh is going to stand up an AWS EC2 instance in an EU region for further investigation. Very much appreciated. Bruce S YahooJSON.pm Description: Binary data ___ gnucash-user mailing list gnucash-user@gnucash.org To update your subscription preferences or to unsubscribe: https://lists.gnucash.org/mailman/listinfo/gnucash-user - Please remember to CC this list on all your replies. You can do this by using Reply-To-List or Reply-All.
Re: [GNC] Finance-Quote 1.60 released!
On Wed, 17 Apr 2024 12:39:51 -0700
"Bruce Schuck" wrote:
> "AS=v=1&s=..." cookie.
>
> ### [Wed Apr 17 08:59:30 2024]cookie_jar : bless( {
> ### COOKIES => {
> ### 'login.yahoo.com' => {
> ### '/' => {
> ### AS => [
> ### 0,
> ###
> 'v=1&s=pdMraThU&d=A6620c4d1|itU7Kpb.2SoujXrNK8pQPMi...
> ### undef,
> ### 1,
> ### 1,
> ### undef,
> ### 1,
> ### {
> ### HttpOnly => undef
> ### }
> ### ]
> ### }
> ### }
> ### }
> ### }, 'HTTP::Cookies' )
>
> The other 3 cookies that I get can see in debug mode are not in the
> cookie jar. My theory is that for those it is not working, they are
> not getting all 4 cookies.
>
Sorry for the delayed response. I had to build packages for missing
dependencie
s required by stockdump.pl.
I'm in the UK and confirm output from stockdump.pl shows only the AS
cookie.
Output from
curl --include
https://login.yahoo.com/?.lang=en-US&src=finance&.done=https%3A%2F%2Ffinance.yahoo.com%2F&pspid=118332&activity=ybar-signin
from the UK gives the same result.
--
Richard
signature.asc
Description: OpenPGP digital signature
___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.
Re: [GNC] Finance-Quote 1.60 released!
Just to touch base again... I'm also located in Germany, and can confirm that when I connect to my US-based VPN price retrieval works. Thanks, Adam On Thu, Apr 18, 2024 at 4:19 PM Bruce Schuck wrote: > > On 4/18/24 06:55, Kalpesh Patel wrote: > > > Any ways it definitely appears to be tied to geo location. Another > > gentleman out of Germany is NOT getting those cookies either. > > Confirmed by the user in Spain I have been working with off-list. > The same user receives the necessary cookies when using a VPN that gives > him a US based IP address. Over that VPN, F::Q and GnuCash return valid > price data. > > > I'll see if I can spin up EC2 in different regions to build the trend > > and then propose changes to the module that could accommodate both > > sides. I need to confirm if subtle changes to the URI is also geo > > based or not to make it logic work better. > > I also had the gentleman in Spain try > "https://login.yahoo.com/config/login"; with the same results. > > Waiting to see if > "https://login.yahoo.com/?.lang=en-US&src=finance&.done=https%3A%2F%2Ffinance.yahoo.com%2F&pspid=118332&activity=ybar-signin"; > from his location yields a different result. > > Thanks again. > > Bruce S. ___ gnucash-user mailing list gnucash-user@gnucash.org To update your subscription preferences or to unsubscribe: https://lists.gnucash.org/mailman/listinfo/gnucash-user - Please remember to CC this list on all your replies. You can do this by using Reply-To-List or Reply-All.
Re: [GNC] No stock and currency quotes anymore
> On Apr 18, 2024, at 02:31, assmsnap--- via gnucash-user > wrote: > > Can't receive anymore stock and currency quotes since a few days. > > I am using Gnucash 5.6 on windows 11, > > Reinstalled Gnucash a few times. > Also did a few times "Online price retrieval for gnucash" > Finance quote is 1.60 and > JSON:: parse is up to date 0.62 > > Look at the attachments and please tell me what to do? See the thread "[GNC] Finance-Quote 1.60 released!". Regards, John Ralls ___ gnucash-user mailing list gnucash-user@gnucash.org To update your subscription preferences or to unsubscribe: https://lists.gnucash.org/mailman/listinfo/gnucash-user - Please remember to CC this list on all your replies. You can do this by using Reply-To-List or Reply-All.
Re: [GNC] GNC] Finance-Quote 1.60 released!
On Thu, 18 Apr 2024 16:13:34 +0200, Klaus writes: I am located in Germany and only one cookie is returned. Here is the top of the output of 'curl --include https://login.yahoo.com': Klaus, Thank you for posting that. It helps confirm this is a geo related issue. Thank you to David Crowe for pointing out https://developer.yahooinc.com/datax/guide/gdpr/cookiemapping/ on https://github.com/finance-quote/finance-quote/issues/373. I suspect GDPR compliance is related to the YahooJSON issue. Additional testing did indicate that the module does work from an Albanian IP address. I guess while this is being researched, users with EU IP addresses can not use the 'yahoo_json' quote method. I believe Kalpesh is going to stand up an AWS EC2 instance in an EU region for further investigation. Very much appreciated. Bruce S ___ gnucash-user mailing list gnucash-user@gnucash.org To update your subscription preferences or to unsubscribe: https://lists.gnucash.org/mailman/listinfo/gnucash-user - Please remember to CC this list on all your replies. You can do this by using Reply-To-List or Reply-All.
Re: [GNC] Finance-Quote 1.60 released!
On 4/18/24 06:55, Kalpesh Patel wrote: Any ways it definitely appears to be tied to geo location. Another gentleman out of Germany is NOT getting those cookies either. Confirmed by the user in Spain I have been working with off-list. The same user receives the necessary cookies when using a VPN that gives him a US based IP address. Over that VPN, F::Q and GnuCash return valid price data. I'll see if I can spin up EC2 in different regions to build the trend and then propose changes to the module that could accommodate both sides. I need to confirm if subtle changes to the URI is also geo based or not to make it logic work better. I also had the gentleman in Spain try "https://login.yahoo.com/config/login"; with the same results. Waiting to see if "https://login.yahoo.com/?.lang=en-US&src=finance&.done=https%3A%2F%2Ffinance.yahoo.com%2F&pspid=118332&activity=ybar-signin"; from his location yields a different result. Thanks again. Bruce S. ___ gnucash-user mailing list gnucash-user@gnucash.org To update your subscription preferences or to unsubscribe: https://lists.gnucash.org/mailman/listinfo/gnucash-user - Please remember to CC this list on all your replies. You can do this by using Reply-To-List or Reply-All.
Re: [GNC] Finance-Quote 1.60 released!
Hi Bruce, I am located in Germany and only one cookie is returned. Here is the top of the output of 'curl --include https://login.yahoo.com': HTTP/2 200 ^M referrer-policy: strict-origin-when-cross-origin^M strict-transport-security: max-age=15552000^M x-content-type-options: nosniff^M x-frame-options: DENY^M x-xss-protection: 1; mode=block^M age: 0^M pragma: no-cache^M expires: 0^M cache-control: no-cache, no-store, must-revalidate^M set-cookie: AS=v=1&s=r6PBcqr2&d=A662274a0|YhvsrWj.2SqTtg_jxRaQvFK8zNTY44tUymYimPg6c9gCwgwhAsCvkscuGtviYS3lDhYSg0DIjR0FtgAahgdU0dycIjClrbS7quY3c0x51rbOvOWuqMWDSt_w3QNqsQMvErv.X3N.5A45vjSWT4FBYyAUtphASWz1tyQlcnj7m7s_xddhIDU1XV9fnv..kIZ6U0Ypmneev8KfHoBjroh0ijcggaaf7s1imDeUbl0dWCCh34Bwuo75RkhnzXsQZx3T0FUsY8biAdAfuUxaENW6BcACSWD7roR6Jl9stOUnCQrhgvtvSn1_p6gjNWFBwcU0WLS3h0kIcEEUxi2ELryZtz1ctoqMaJ_cgH8MlXmuS.POGnZLqJOWjaAA7Z2Lf92chAsN5wZwtl7dF4KAbM5VmfEkVFCRC8_NKvwJehQ40eiZsDSRofUViNg_bNFcFmVrAaik1HkpI.1awx_AinCac7heQ48OEztcroCWItDPKlKddxppKRKfr44zhrNrAL5ftcCsdgcbEPHHDA1fJxplLDCY.RRbRSVpdkAfrCZfazTxPWVJ_Az3RAbThwAqAVLwssV0ZEpeO0hM8yU9kmiLbZUUxa22jgTKBJLhrkyeeV6jqM5IR_xXGndAENVs.fLjNXuX5ZXhF7oGStEVVp_2GFteyn5TJzHCL2TgHVjd_nK3EO0fuZfo8bWVgqudW_MNuQlwADDE7GggAxoNdzD9MC4IAUl.8bZwokYjEKQuspXfyu3Kp8E-~A; path=/; domain=login.yahoo.com; secure; HttpOnly^M content-type: text/html; charset=utf-8^M content-length: 37389^M Best regards Klaus On Wed, 17 Apr 2024 14:09:37 -0700 Bruce Schuck wrote: ... > > The user having an issue is in Europe, I believe Spain. Maybe this is a > geo based issue? Just guessing. > ___ gnucash-user mailing list gnucash-user@gnucash.org To update your subscription preferences or to unsubscribe: https://lists.gnucash.org/mailman/listinfo/gnucash-user - Please remember to CC this list on all your replies. You can do this by using Reply-To-List or Reply-All.
Re: [GNC] No stock and currency quotes anymore
Here is the fix for windos 11. worked for me On 4/13/24 20:08:20 -0700, Bruce S wrote: > There is some miscellaneous housekeeping and cleanup that needs to be > done before pushing a final release to CPAN. Plus I had some other > changes that I was planning for v1.60 but haven't done yet. Instead of > v1.60, I may upload v1.59_01 tomorrow so people can at least fetch the > fix for YahooJSON before v1.60 is uploaded and indexed by CPAN. Pre-release F::Q v1.59_01 has been uploaded to CPAN. To install using cpan or cpanm you must specify the path. cpan> install BPSCHUCK/Finance-Quote-1.59_01.tar.gz Bruce S. On Thursday, April 18, 2024 at 02:55:16 AM GMT-7, assmsnap--- via gnucash-user wrote: Can't receive anymore stock and currency quotes since a few days. I am using Gnucash 5.6 on windows 11, Reinstalled Gnucash a few times. Also did a few times "Online price retrieval for gnucash" Finance quote is 1.60 and JSON:: parse is up to date 0.62 Look at the attachments and please tell me what to do? ___ gnucash-user mailing list gnucash-user@gnucash.org To update your subscription preferences or to unsubscribe: https://lists.gnucash.org/mailman/listinfo/gnucash-user - Please remember to CC this list on all your replies. You can do this by using Reply-To-List or Reply-All. Online price retrieval.png Description: Binary data Result retrieving quotes.png Description: Binary data ___ gnucash-user mailing list gnucash-user@gnucash.org To update your subscription preferences or to unsubscribe: https://lists.gnucash.org/mailman/listinfo/gnucash-user - Please remember to CC this list on all your replies. You can do this by using Reply-To-List or Reply-All.
Re: [GNC] Finance-Quote 1.60 released!
Bruce -- Sorry, saving cookies part wasn't for you.
Any ways it definitely appears to be tied to geo location. Another gentleman
out of Germany is NOT getting those cookies either.
I'll see if I can spin up EC2 in different regions to build the trend and then
propose changes to the module that could accommodate both sides. I need to
confirm if subtle changes to the URI is also geo based or not to make it logic
work better.
-Original Message-
From: Bruce Schuck
Sent: Wednesday, April 17, 2024 3:40 PM
To: 'GnuCash User'
Cc: rull...@protonmail.com; adam.grif...@gmail.com; Kalpesh Patel
Subject: Re: [GNC] Finance-Quote 1.60 released!
On 4/17/24 11:57 AM, Kalpesh Patel wrote:
> You can also save cookies to a file named cookies.txt as follows:
> #curl -c cookies.txt https://login.yahoo.com -I
> and then following to display 11 characters crumb by using cookies
> saved in previous command: #curl -H "user-agent: Mozilla/5.0
> (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/537.36 (KHTML, like
> Gecko) Chrome/39.0.2171.95 Safari/537.3" -b cookies.txt
> https://query2.finance.yahoo.com/v1/test/getcrumb
I'm not interested in saving the cookies at this time. I've been having a
discussion with another user having the same (or similar) issue. In debug mode
his cookie jar has only 1 cookie, the "AS=v=1&s=..." cookie.
### [Wed Apr 17 08:59:30 2024]cookie_jar : bless( {
### COOKIES => {
### 'login.yahoo.com' => {
### '/' => {
### AS => [
### 0,
###
'v=1&s=pdMraThU&d=A6620c4d1|itU7Kpb.2SoujXrNK8pQPMi...
### undef,
### 1,
### 1,
### undef,
### 1,
### {
### HttpOnly => undef
### }
### ]
### }
### }
### }
### }, 'HTTP::Cookies' )
The other 3 cookies that I get can see in debug mode are not in the cookie jar.
My theory is that for those it is not working, they are not getting all 4
cookies.
Bruce S
___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.
[GNC] No stock and currency quotes anymore
Can't receive anymore stock and currency quotes since a few days. I am using Gnucash 5.6 on windows 11, Reinstalled Gnucash a few times. Also did a few times "Online price retrieval for gnucash" Finance quote is 1.60 and JSON:: parse is up to date 0.62 Look at the attachments and please tell me what to do? Online price retrieval.png Description: Binary data Result retrieving quotes.png Description: Binary data ___ gnucash-user mailing list gnucash-user@gnucash.org To update your subscription preferences or to unsubscribe: https://lists.gnucash.org/mailman/listinfo/gnucash-user - Please remember to CC this list on all your replies. You can do this by using Reply-To-List or Reply-All.
