Re: [GNC] AqBanking help for Citi CC

2018-10-23 Thread Liang Wang
Thanks! It works for my Citi Costco card.
On Tue, Oct 23, 2018 at 9:12 PM Jim Maki via gnucash-user
 wrote:
>
> I just successfully set up GnuCash to download Citi credit card data
> using AqBanking - for now all you have to do is add a space to the end
> of your userid (assuming everything else is correct).The issue seems to
> be with Citi ...
>
> When it consistently failed with code 403, I turned on OFX logging
> (export AQOFX_LOG_COMM=1), snagged the OFX request (from /tmp/ofx.log),
> formatted it to make it more readable, and created a bash script using
> curl to make the OFX request. Paradoxically it worked while the
> equivalent un-beautified GnuCash request failed.
>
> After little debugging, the key lines in the GnuCash ofx.log were:
>
> == OFX ==
> ...
> ... myuserid
> mypassword
> ...
> == OFX ==
>
> The above will work if you add a space either at the end of the
> "...myuserid" line, or before "" in the next line. At
> the GnuCash user interface level that involves adding a trailing space
> to the AqBanking userid for Citi.
>
> For reference, below is the OFX template file I use to feed my
> curl-based script. Eventually GnuCash makes an equivalent request.
> (Again, eliminate the leading spaces before "" and it, too fails.)
>
> == OFX ==
> OFXHEADER:100
> DATA:OFXSGML
> VERSION:103
> SECURITY:NONE
> ENCODING:USASCII
> CHARSET:1252
> COMPRESSION:NONE
> OLDFILEUID:NONE
> NEWFILEUID:$OFX_DATETIME
>
> 
> 
> 
> $OFX_DATETIME
> $OFX_USER
> $OFX_PW
> ENG
> 
> $OFX_ORG
> $OFX_FID
> 
> QWIN
> 2400
> 
> 
> 
> 
> $OFX_DATETIME
> 1
> 
> 
> $OFX_ACCOUNT
> 
> 
> $OFX_STARTDATE
> $OFX_ENDDATE
> Y
> 
> 
> 
> 
> 
> == OFX ==
>
> If GnuCash did prettified SGML it would avoid this problem with Citi's
> parsing.
>
>Jim
>
> ___
> gnucash-user mailing list
> gnucash-user@gnucash.org
> To update your subscription preferences or to unsubscribe:
> https://lists.gnucash.org/mailman/listinfo/gnucash-user
> If you are using Nabble or Gmane, please see 
> https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
> -
> Please remember to CC this list on all your replies.
> You can do this by using Reply-To-List or Reply-All.
___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
If you are using Nabble or Gmane, please see 
https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.


Re: [GNC] AqBanking help for Citi CC

2018-10-23 Thread Jim Maki via gnucash-user
I just successfully set up GnuCash to download Citi credit card data 
using AqBanking - for now all you have to do is add a space to the end 
of your userid (assuming everything else is correct).The issue seems to 
be with Citi ...


When it consistently failed with code 403, I turned on OFX logging 
(export AQOFX_LOG_COMM=1), snagged the OFX request (from /tmp/ofx.log), 
formatted it to make it more readable, and created a bash script using 
curl to make the OFX request. Paradoxically it worked while the 
equivalent un-beautified GnuCash request failed.


After little debugging, the key lines in the GnuCash ofx.log were:

== OFX ==
...
... myuserid
mypassword
...
== OFX ==

The above will work if you add a space either at the end of the 
"...myuserid" line, or before "" in the next line. At 
the GnuCash user interface level that involves adding a trailing space 
to the AqBanking userid for Citi.


For reference, below is the OFX template file I use to feed my 
curl-based script. Eventually GnuCash makes an equivalent request. 
(Again, eliminate the leading spaces before "" and it, too fails.)


== OFX ==
OFXHEADER:100
DATA:OFXSGML
VERSION:103
SECURITY:NONE
ENCODING:USASCII
CHARSET:1252
COMPRESSION:NONE
OLDFILEUID:NONE
NEWFILEUID:$OFX_DATETIME




$OFX_DATETIME
$OFX_USER
$OFX_PW
ENG

$OFX_ORG
$OFX_FID

QWIN
2400




$OFX_DATETIME
1


$OFX_ACCOUNT


$OFX_STARTDATE
$OFX_ENDDATE
Y





== OFX ==

If GnuCash did prettified SGML it would avoid this problem with Citi's 
parsing.


  Jim

___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
If you are using Nabble or Gmane, please see 
https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.

Re: [GNC] Libboost_regex needed

2018-10-23 Thread Stephen M. Butler

On 10/23/18 8:54 AM, Colin Law wrote:

I have not heard of any problems with encrypted drives on Ubuntu
18.04, did you ask on, for example, the Ubuntu Users list for help
getting it sorted?



Problem happened on 18.10 after upgrade and reboot.  Folks gave 
suggestions and it made things worse.


At least I'm back up with my restore from backup.



Colin
On Tue, 23 Oct 2018 at 16:49, Stephen M. Butler  wrote:

Not sure who maintains the Wiki for Ubuntu builds, but I had to install
libboost-all-dev on my Ubuntu 18.04 last night in order to run GnuCash
after a successful compile/build.

Longer story --

Tried to upgrade to 18.10.  Worked until I shut down and powered up the
next morning.  Could not mount the home directory (turns out it is
encrypted and the mount got a "bad address").  Trying to roll back to
18.04 compounded the problem (booting off a live USB ISO reported the
disk config was wrong).

I finally gave up and loaded a fresh Ubuntu 18.04 and have spent the
last two days getting things installed and back running. GnuCash was one
of the last ones.  I pulled the latest from github (git clone) did a
clean cmake, make, sudo make install but ran into the missing shared
library libboost-regex.  After an hour of digging I finally found
reference to libboost-all-dev.  That installed a lot of things but cured
the missing shared library.

I think I'll give 18.10 a couple of months to mature some more. I also
un-encrypted the home directory.  Thankfully the restore from the daily
backups worked (took a long time).

Wish there was a way to backup the current o/s state and restore/reload
it automatically rather than all that typing I had to do to get items
added back.  I'm sure I missed a lot (my favorites are not so crowded
today)!

--Steve

--
Stephen M Butler, PMP, PSM
stephen.m.butle...@gmail.com
kg...@arrl.net
253-350-0166
---
GnuPG Fingerprint:  8A25 9726 D439 758D D846 E5D4 282A 5477 0385 81D8

___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
If you are using Nabble or Gmane, please see 
https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.

___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
If you are using Nabble or Gmane, please see 
https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.



--
Stephen M Butler, PMP, PSM
stephen.m.butle...@gmail.com
kg...@arrl.net
253-350-0166
---
GnuPG Fingerprint:  8A25 9726 D439 758D D846 E5D4 282A 5477 0385 81D8

___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
If you are using Nabble or Gmane, please see 
https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.

Re: [GNC] Libboost_regex needed

2018-10-23 Thread Ronal B Morse
On Tue, 2018-10-23 at 08:46 -0700, Stephen M. Butler wrote:
> 
> Wish there was a way to backup the current o/s state and
> restore/reload it automatically rather than all that
> typing I had to do to get items added back.  I'm sure I
> missed a lot (my favorites are not so crowded today)!
> 
> --Steve
> 
Off topic so I'll keep it short, but Linux Mint uses a
utility called "Timeshift" for this purpose.  You can
install it into Ubuntu from a .ppa repo. Google search will
take you there.  

I've used Timeshift and recommend it. 

RBM


___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
If you are using Nabble or Gmane, please see 
https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.


Re: [GNC] Libboost_regex needed

2018-10-23 Thread Colin Law
I have not heard of any problems with encrypted drives on Ubuntu
18.04, did you ask on, for example, the Ubuntu Users list for help
getting it sorted?

Colin
On Tue, 23 Oct 2018 at 16:49, Stephen M. Butler  wrote:
>
> Not sure who maintains the Wiki for Ubuntu builds, but I had to install
> libboost-all-dev on my Ubuntu 18.04 last night in order to run GnuCash
> after a successful compile/build.
>
> Longer story --
>
> Tried to upgrade to 18.10.  Worked until I shut down and powered up the
> next morning.  Could not mount the home directory (turns out it is
> encrypted and the mount got a "bad address").  Trying to roll back to
> 18.04 compounded the problem (booting off a live USB ISO reported the
> disk config was wrong).
>
> I finally gave up and loaded a fresh Ubuntu 18.04 and have spent the
> last two days getting things installed and back running. GnuCash was one
> of the last ones.  I pulled the latest from github (git clone) did a
> clean cmake, make, sudo make install but ran into the missing shared
> library libboost-regex.  After an hour of digging I finally found
> reference to libboost-all-dev.  That installed a lot of things but cured
> the missing shared library.
>
> I think I'll give 18.10 a couple of months to mature some more. I also
> un-encrypted the home directory.  Thankfully the restore from the daily
> backups worked (took a long time).
>
> Wish there was a way to backup the current o/s state and restore/reload
> it automatically rather than all that typing I had to do to get items
> added back.  I'm sure I missed a lot (my favorites are not so crowded
> today)!
>
> --Steve
>
> --
> Stephen M Butler, PMP, PSM
> stephen.m.butle...@gmail.com
> kg...@arrl.net
> 253-350-0166
> ---
> GnuPG Fingerprint:  8A25 9726 D439 758D D846 E5D4 282A 5477 0385 81D8
>
> ___
> gnucash-user mailing list
> gnucash-user@gnucash.org
> To update your subscription preferences or to unsubscribe:
> https://lists.gnucash.org/mailman/listinfo/gnucash-user
> If you are using Nabble or Gmane, please see 
> https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
> -
> Please remember to CC this list on all your replies.
> You can do this by using Reply-To-List or Reply-All.
___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
If you are using Nabble or Gmane, please see 
https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.


[GNC] Libboost_regex needed

2018-10-23 Thread Stephen M. Butler
Not sure who maintains the Wiki for Ubuntu builds, but I had to install 
libboost-all-dev on my Ubuntu 18.04 last night in order to run GnuCash 
after a successful compile/build.


Longer story --

Tried to upgrade to 18.10.  Worked until I shut down and powered up the 
next morning.  Could not mount the home directory (turns out it is 
encrypted and the mount got a "bad address").  Trying to roll back to 
18.04 compounded the problem (booting off a live USB ISO reported the 
disk config was wrong).


I finally gave up and loaded a fresh Ubuntu 18.04 and have spent the 
last two days getting things installed and back running. GnuCash was one 
of the last ones.  I pulled the latest from github (git clone) did a 
clean cmake, make, sudo make install but ran into the missing shared 
library libboost-regex.  After an hour of digging I finally found 
reference to libboost-all-dev.  That installed a lot of things but cured 
the missing shared library.


I think I'll give 18.10 a couple of months to mature some more. I also 
un-encrypted the home directory.  Thankfully the restore from the daily 
backups worked (took a long time).


Wish there was a way to backup the current o/s state and restore/reload 
it automatically rather than all that typing I had to do to get items 
added back.  I'm sure I missed a lot (my favorites are not so crowded 
today)!


--Steve

--
Stephen M Butler, PMP, PSM
stephen.m.butle...@gmail.com
kg...@arrl.net
253-350-0166
---
GnuPG Fingerprint:  8A25 9726 D439 758D D846 E5D4 282A 5477 0385 81D8

___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
If you are using Nabble or Gmane, please see 
https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.

Re: [GNC] OFX import when bank doesn't use unique ACCTID

2018-10-23 Thread Ryan Boder
On Tue, Oct 23, 2018 at 9:07 AM D  wrote:

> Ryan,
>
> Another option is to suggest to your bank that they are not implementing
> OFX properly, and encourage them to issue unique ACCTIDs for each account...
>

Agreed. I've already done that. I just don't have high hopes that they will
fix it any time soon. I'll be surprised if I can even get through customer
service to their developers.

- Ryan
___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
If you are using Nabble or Gmane, please see 
https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.


Re: [GNC] OFX import when bank doesn't use unique ACCTID

2018-10-23 Thread D via gnucash-user
Ryan,

Another option is to suggest to your bank that they are not implementing OFX 
properly, and encourage them to issue unique ACCTIDs for each account...

On October 23, 2018, at 4:46 PM, Ryan Boder  wrote:

On Mon, Oct 22, 2018 at 10:31 PM David Reiser  wrote:

> > On Oct 22, 2018, at 9:27 PM, Ryan Boder  wrote:
> >
> > I'm new to gnucash and have run into a frustrating problem importing my
> > bank accounts. My bank is putting a non-unique number in the ACCTID field
> > of the OFX files. They only put the last 4 digits of what they call the
> > "member number product ID" in as the ACCTID. I have multiple accounts
> with
> > this bank and all my accounts have the same last 4 digits in that ID.
>
> Are they sending you more than one account per file. That is permissible
> in the OFX standard, but there would have to be something that identified
> the subaccount uniquely. Is there some other line in the file that provides
> ID of the subaccount? If so, one option is to process each file via script
> (that you’d have to write) before importing. If your bank doesn’t give you
> any way to tell which account one OFX file is from vs another OFX file,
> that’s a user hostile bank.
>

The OFX files only have 1 account each. I download a separate OFX file per
account. The problem is each file has the same information in
the BANKACCTFROM section, even for my different accounts (1 for each family
member):


USA
0090
CHECKING


0090 is the last 4 digits of the "member number product ID" for all my
accounts. The full member number product ID is unique but the bank only
puts the last 4 digits in the OFX file. I suppose that means the bank is
doing it wrong? I can reach out and ask them to fix it but I wouldn't hold
my breath on that happening.

I'll use the approach you recommended and write a script to preprocess the
OFX files and insert the full ID.



> >
> > 3) My bank supports CSV export as well as OFX/QFX. I could avoid OFX all
> > together and try to make something work with CSV. This doesn't seem ideal
> > as it's not a standard file format and it looks like I would have to do
> > some manipulation of some of the fields to make it work in Gnucash.
>
> The Gnucash version 3.x CSV importer is much better than prior versions.
> If your CSV has any structure at all, it should be possible to set up the
> import settings to get the data, and save those settings so you never have
> to edit them again — just pick the settings definition in a dropdown menu
> during the import. The CSV importer has the added advantage that you get a
> look at the file you’re importing and can tweak the settings and see the
> filtering results before actually importing the file.
>

You're right, CSV import does work out of the box. It just took tinkering
and figuring out the right settings. So I have 2 usable solutions.

Thanks Dave!

- Ryan
___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
If you are using Nabble or Gmane, please see 
https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.
___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
If you are using Nabble or Gmane, please see 
https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.

Re: [GNC] OFX import when bank doesn't use unique ACCTID

2018-10-23 Thread Ryan Boder
On Mon, Oct 22, 2018 at 10:31 PM David Reiser  wrote:

> > On Oct 22, 2018, at 9:27 PM, Ryan Boder  wrote:
> >
> > I'm new to gnucash and have run into a frustrating problem importing my
> > bank accounts. My bank is putting a non-unique number in the ACCTID field
> > of the OFX files. They only put the last 4 digits of what they call the
> > "member number product ID" in as the ACCTID. I have multiple accounts
> with
> > this bank and all my accounts have the same last 4 digits in that ID.
>
> Are they sending you more than one account per file. That is permissible
> in the OFX standard, but there would have to be something that identified
> the subaccount uniquely. Is there some other line in the file that provides
> ID of the subaccount? If so, one option is to process each file via script
> (that you’d have to write) before importing. If your bank doesn’t give you
> any way to tell which account one OFX file is from vs another OFX file,
> that’s a user hostile bank.
>

The OFX files only have 1 account each. I download a separate OFX file per
account. The problem is each file has the same information in
the BANKACCTFROM section, even for my different accounts (1 for each family
member):


USA
0090
CHECKING


0090 is the last 4 digits of the "member number product ID" for all my
accounts. The full member number product ID is unique but the bank only
puts the last 4 digits in the OFX file. I suppose that means the bank is
doing it wrong? I can reach out and ask them to fix it but I wouldn't hold
my breath on that happening.

I'll use the approach you recommended and write a script to preprocess the
OFX files and insert the full ID.



> >
> > 3) My bank supports CSV export as well as OFX/QFX. I could avoid OFX all
> > together and try to make something work with CSV. This doesn't seem ideal
> > as it's not a standard file format and it looks like I would have to do
> > some manipulation of some of the fields to make it work in Gnucash.
>
> The Gnucash version 3.x CSV importer is much better than prior versions.
> If your CSV has any structure at all, it should be possible to set up the
> import settings to get the data, and save those settings so you never have
> to edit them again — just pick the settings definition in a dropdown menu
> during the import. The CSV importer has the added advantage that you get a
> look at the file you’re importing and can tweak the settings and see the
> filtering results before actually importing the file.
>

You're right, CSV import does work out of the box. It just took tinkering
and figuring out the right settings. So I have 2 usable solutions.

Thanks Dave!

- Ryan
___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
If you are using Nabble or Gmane, please see 
https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.