Re: [GNC] Import Map Editor

[Liz Dodd]

On Thu, 6 Oct 2022 14:28:21 -0700
Jim DeLaHunt  wrote:

> On 2022-10-06 05:58, Carl S. wrote:
> 
> > I'm curious about the Import Map Editor and what it's for.  
> 
> Have you read the documentation about it, at 
> ,
>  
> yet?
> 
> 
> > It does say I've got something like 300 invalid mapping and asks if
> > I want to delete them.
> >
> > No idea what to do with itand certainly don't want to create a 
> > disaster.
> >  
> The documentation does not describe that message. Perhaps post a 
> screenshot of the message?  Does the dialogue indicate which entries
> are "invalid"?  Can you post a screenshot of those entries?
> 
> 
> > Thanks,
> >
> > Carl  
> Good luck,
>      —Jim DeLaHunt


May I suggest you make a copy of your file and experiment with the
copy? That would make a disaster less likely.

Liz
___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.

Re: [GNC] Import Map Editor

[Jim DeLaHunt]

On 2022-10-06 05:58, Carl S. wrote:


I'm curious about the Import Map Editor and what it's for.


Have you read the documentation about it, at 
, 
yet?



It does say I've got something like 300 invalid mapping and asks if I 
want to delete them.


No idea what to do with itand certainly don't want to create a 
disaster.


The documentation does not describe that message. Perhaps post a 
screenshot of the message?  Does the dialogue indicate which entries are 
"invalid"?  Can you post a screenshot of those entries?




Thanks,

Carl

Good luck,
    —Jim DeLaHunt

___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.

Re: [GNC] Import Map Editor - accidentally deleted account

[davidcousens49]

Bogdan,  
I have no problem deleting individual match strings in the import map editor in
GC4.10 on Linux mint 20.3.   I used to do it occasionally in  several of the 3.x
versons as well but I have never deleted all the strings for a given account. It
may be that action which is causing the problem. For some reason the Bayesian
editor includes date information in the account matching so the token database
ends up with a lot of entries with a frequency of 1 or 2 which should have
little or no effect on the Bayesian matching.  The matching process is also
different if you have the Bayesian matching disabled although I think it is now
the default matching process. 
David.
On Fri, 2022-05-20 at 10:26 +0200, Bogdan wrote:
> Hi David, 
> Thanks, that's of course how I tried to delete an individual token - by
> highlighting the item and yet it would delete the entire account. That bug
> happened on several accounts but I can't reproduce it on some other accounts
> where I could delete tokens just fine. So I guess this is something to watch
> out for if other users complain.  
> The problem is not so much the loss of the previously created tokens /
> mappings but inability to create new tokens for the account. I've tried to
> start from scratch hoping new imports would create tokens for the account but
> they do not and the account / new mappings simply do not show up in the Import
> Map Editor after new imports. The same is actually true even for 
> newly-created 
> accounts - tokens are not recorded on import. What could be wrong? 
> Thanks! 
> 
> On Fri, May 20, 2022 at 2:39 AM  wrote:
> > Bogdan,
> > When you open the import map editor it normally shows a list of accounts and
> > each of those accounts has an down arrow to the left of it. If you click on
> > the down arrow the list will expand to show the token entries  (match
> > strings) associated with that account. You can then select the specific
> > search strings you want to delete and these will be highlighted. Mmultiple
> > items can be selected using the usual Ctrl-click and Shift-click mechanisms.
> > Only the highlighted strings will then be deleted. If you highlight the
> > account entry at the top of the list then all entries associated with that
> > account get deleted which would appear to be what has happened in your case.
> > Unfortunately there is no undo button so the information is permanently
> > lost.  The documentation is in the help manual at 
> > https://www.gnucash.org/docs/v4/C/gnucash-help/trans-import.html#:~:text=Import%20Match%20Editor,Map%20Editor%20from%20the%20menu
> > . however the above drop-down action is not documented there. I will patch
> > it to add the above.
> > It might be more appropriate to issue a warning that you are going to delete
> > all match information for an account where the item selected is an account
> > entry rather than an individual match string and ask for confirmation that
> > this is what is intended
> > David Cousens
> > On Fri, 2022-05-20 at 00:29 +0200, Bogdan wrote:
> > > Hello,
> > > 
> > > The course of the problem is that I tried to delete a specific mapping for
> > > a specific account in the Import Map Editor and instead it would delete
> > > the entire account with all mappings (that is, in the Map Editor, not the
> > > account itself). That looks like a bug.
> > > 
> > > Anyway, it doesn't seem possible to retrain the system by new importing
> > > (and setting values) i.e. identical transactions are not recognized on
> > > subsequent imports. I assume it's because the account is no longer being
> > > mapped to on import (and is not visible anymore in the Map Editor as
> > > mentioned above). Hence my original question on how to re-instate the
> > > account in the datafile / Map Editor for mapping if possible at all?
> > > 
> > > 
> > > 
> > > On Thu, May 19, 2022, 04:14   wrote:
> > > > Bogdan
> > > > 
> > > > 
> > > > 
> > > > AFAIK the import mapping data is stored in the main data file as is the
> > > > price
> > > > 
> > > > database data. I don't know if the log files record changes to the
> > > > import map
> > > > 
> > > > editor or only transaction changes. I suspect if you have deleted
> > > > something in
> > > > 
> > > > the import map editor your only recourse will be to  retrain the system
> > > > by
> > > > 
> > > > setting the values for unmapped transactions during the import process.
> > > > It
> > > > 
> > > > probably pays to have a very good idea of how the import mapping
> > > > functions
> > > > 
> > > > before editing the map data as it can have some unwanted consequences.
> > > > 
> > > > 
> > > > 
> > > > David Cousens
> > > > 
> > > > 
> > > > 
> > > > On Wed, 2022-05-18 at 23:45 +0200, Bogdan wrote:
> > > > 
> > > > > Hello,
> > > > 
> > > > > 
> > > > 
> > > > > I don't have a "qif-accounts-map" file on my system.  I've been
> > > > importing
> > > > 
> > > > > OFX rather than QIF format. Where else would the mapping for these
> > > > imports
> > > > 
> 

Re: [GNC] Import Map Editor - accidentally deleted account

[Bogdan]

Hi David,

Thanks, that's of course how I tried to delete an individual token - by
highlighting the item and yet it would delete the entire account. That bug
happened on several accounts but I can't reproduce it on some other
accounts where I could delete tokens just fine. So I guess this is
something to watch out for if other users complain.

The problem is not so much the loss of the previously created tokens /
mappings but inability to create new tokens for the account. I've tried to
start from scratch hoping new imports would create tokens for the account
but they do not and the account / new mappings simply do not show up in the
Import Map Editor after new imports. The same is actually true even for
newly-created accounts - tokens are not recorded on import. What could be
wrong?

Thanks!


On Fri, May 20, 2022 at 2:39 AM  wrote:

> Bogdan,
>
> When you open the import map editor it normally shows a list of accounts
> and each of those accounts has an down arrow to the left of it. If you
> click on the down arrow the list will expand to show the token entries
>  (match strings) associated with that account. You can then select the
> specific search strings you want to delete and these will be highlighted.
> Mmultiple items can be selected using the usual Ctrl-click and Shift-click
> mechanisms. Only the highlighted strings will then be deleted. If you
> highlight the account entry at the top of the list then all entries
> associated with that account get deleted which would appear to be what has
> happened in your case. Unfortunately there is no undo button so the
> information is permanently lost.  The documentation is in the help manual
> at
> https://www.gnucash.org/docs/v4/C/gnucash-help/trans-import.html#:~:text=Import%20Match%20Editor,Map%20Editor%20from%20the%20menu.
> however the above drop-down action is not documented there. I will patch it
> to add the above.
>
> It might be more appropriate to issue a warning that you are going to
> delete all match information for an account where the item selected is an
> account entry rather than an individual match string and ask for
> confirmation that this is what is intended
>
> David Cousens
>
> On Fri, 2022-05-20 at 00:29 +0200, Bogdan wrote:
>
> Hello,
>
> The course of the problem is that I tried to delete a specific mapping for
> a specific account in the Import Map Editor and instead it would delete the
> entire account with all mappings (that is, in the Map Editor, not the
> account itself). That looks like a bug.
>
> Anyway, it doesn't seem possible to retrain the system by new importing
> (and setting values) i.e. identical transactions are not recognized on
> subsequent imports. I assume it's because the account is no longer being
> mapped to on import (and is not visible anymore in the Map Editor as
> mentioned above). Hence my original question on how to re-instate the
> account in the datafile / Map Editor for mapping if possible at all?
>
>
>
> On Thu, May 19, 2022, 04:14  wrote:
>
> Bogdan
>
> AFAIK the import mapping data is stored in the main data file as is the
> price
> database data. I don't know if the log files record changes to the import
> map
> editor or only transaction changes. I suspect if you have deleted
> something in
> the import map editor your only recourse will be to  retrain the system by
> setting the values for unmapped transactions during the import process. It
> probably pays to have a very good idea of how the import mapping functions
> before editing the map data as it can have some unwanted consequences.
>
> David Cousens
>
> On Wed, 2022-05-18 at 23:45 +0200, Bogdan wrote:
> > Hello,
> >
> > I don't have a "qif-accounts-map" file on my system.  I've been importing
> > OFX rather than QIF format. Where else would the mapping for these
> imports
> > be stored?
> >
> >
> > On Wed, May 18, 2022 at 1:28 AM Tommy Trussell  >
> > wrote:
> >
> > > I don't regularly import data, so I am not sure...
> > >
> > > HOWEVER what happens if you quit GnuCash, move the qif-accounts-map
> file
> > > to another place, then open GnuCash and try the import again?
> > >
> > > https://wiki.gnucash.org/wiki/Configuration_Locations
> > >
> > > If this is "dangerous" I hope someone jumps in. Since I haven't used
> the
> > > importer on this system I don't even see the file, so I presume it gets
> > > automatically created when necessary during the import process.
> > >
> > > Please be sure to report back whether thad does or does not work!
> > >
> > >
> > > On Sat, May 14, 2022 at 2:26 AM Bogdan  wrote:
> > >
> > > > Hello, does anybody have a suggestion how to fix the import map
> editor?
> > > >
> > > > On Wed, May 11, 2022, 12:26 Bogdan  wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > I've accidentally deleted several accounts in the Import Map
> Editor -
> > > > > Bayesian (actually, I was trying to delete a match string but it
> would
> > > > > delete the entire source account with all match strings). Now,
> > > > obviously,
> 

Re: [GNC] Import Map Editor - accidentally deleted account

[Bogdan]

Hello,

The course of the problem is that I tried to delete a specific mapping for
a specific account in the Import Map Editor and instead it would delete the
entire account with all mappings (that is, in the Map Editor, not the
account itself). That looks like a bug.

Anyway, it doesn't seem possible to retrain the system by new importing
(and setting values) i.e. identical transactions are not recognized on
subsequent imports. I assume it's because the account is no longer being
mapped to on import (and is not visible anymore in the Map Editor as
mentioned above). Hence my original question on how to re-instate the
account in the datafile / Map Editor for mapping if possible at all?



On Thu, May 19, 2022, 04:14  wrote:

> Bogdan
>
> AFAIK the import mapping data is stored in the main data file as is the
> price
> database data. I don't know if the log files record changes to the import
> map
> editor or only transaction changes. I suspect if you have deleted
> something in
> the import map editor your only recourse will be to  retrain the system by
> setting the values for unmapped transactions during the import process. It
> probably pays to have a very good idea of how the import mapping functions
> before editing the map data as it can have some unwanted consequences.
>
> David Cousens
>
> On Wed, 2022-05-18 at 23:45 +0200, Bogdan wrote:
> > Hello,
> >
> > I don't have a "qif-accounts-map" file on my system.  I've been importing
> > OFX rather than QIF format. Where else would the mapping for these
> imports
> > be stored?
> >
> >
> > On Wed, May 18, 2022 at 1:28 AM Tommy Trussell  >
> > wrote:
> >
> > > I don't regularly import data, so I am not sure...
> > >
> > > HOWEVER what happens if you quit GnuCash, move the qif-accounts-map
> file
> > > to another place, then open GnuCash and try the import again?
> > >
> > > https://wiki.gnucash.org/wiki/Configuration_Locations
> > >
> > > If this is "dangerous" I hope someone jumps in. Since I haven't used
> the
> > > importer on this system I don't even see the file, so I presume it gets
> > > automatically created when necessary during the import process.
> > >
> > > Please be sure to report back whether thad does or does not work!
> > >
> > >
> > > On Sat, May 14, 2022 at 2:26 AM Bogdan  wrote:
> > >
> > > > Hello, does anybody have a suggestion how to fix the import map
> editor?
> > > >
> > > > On Wed, May 11, 2022, 12:26 Bogdan  wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > I've accidentally deleted several accounts in the Import Map
> Editor -
> > > > > Bayesian (actually, I was trying to delete a match string but it
> would
> > > > > delete the entire source account with all match strings). Now,
> > > > obviously,
> > > > > matching on import no longer works for these accounts.
> > > > >
> > > >
> > > > Is there a way to restore it?
> > > >
> > > > Making a new import does not record the missing account in the
> Import Map
> > > > > Editor (and match strings are not recorded).
> > > > >
> > > > > Thanks!
> > > > >
> > > > ___
> > > > gnucash-user mailing list
> > > > gnucash-user@gnucash.org
> > > > To update your subscription preferences or to unsubscribe:
> > > > https://lists.gnucash.org/mailman/listinfo/gnucash-user
> > > > If you are using Nabble or Gmane, please see
> > > > https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
> > > > -
> > > > Please remember to CC this list on all your replies.
> > > > You can do this by using Reply-To-List or Reply-All.
> > > >
> > ___
> > gnucash-user mailing list
> > gnucash-user@gnucash.org
> > To update your subscription preferences or to unsubscribe:
> > https://lists.gnucash.org/mailman/listinfo/gnucash-user
> > If you are using Nabble or Gmane, please see
> > https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
> > -
> > Please remember to CC this list on all your replies.
> > You can do this by using Reply-To-List or Reply-All.
>
> ___
> gnucash-user mailing list
> gnucash-user@gnucash.org
> To update your subscription preferences or to unsubscribe:
> https://lists.gnucash.org/mailman/listinfo/gnucash-user
> If you are using Nabble or Gmane, please see
> https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
> -
> Please remember to CC this list on all your replies.
> You can do this by using Reply-To-List or Reply-All.
>
___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
If you are using Nabble or Gmane, please see 
https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.

Re: [GNC] Import Map Editor - accidentally deleted account

[davidcousens49]

Bogdan

AFAIK the import mapping data is stored in the main data file as is the price
database data. I don't know if the log files record changes to the import map
editor or only transaction changes. I suspect if you have deleted something in
the import map editor your only recourse will be to  retrain the system by
setting the values for unmapped transactions during the import process. It
probably pays to have a very good idea of how the import mapping functions
before editing the map data as it can have some unwanted consequences.

David Cousens

On Wed, 2022-05-18 at 23:45 +0200, Bogdan wrote:
> Hello,
> 
> I don't have a "qif-accounts-map" file on my system.  I've been importing
> OFX rather than QIF format. Where else would the mapping for these imports
> be stored?
> 
> 
> On Wed, May 18, 2022 at 1:28 AM Tommy Trussell 
> wrote:
> 
> > I don't regularly import data, so I am not sure...
> > 
> > HOWEVER what happens if you quit GnuCash, move the qif-accounts-map file
> > to another place, then open GnuCash and try the import again?
> > 
> > https://wiki.gnucash.org/wiki/Configuration_Locations
> > 
> > If this is "dangerous" I hope someone jumps in. Since I haven't used the
> > importer on this system I don't even see the file, so I presume it gets
> > automatically created when necessary during the import process.
> > 
> > Please be sure to report back whether thad does or does not work!
> > 
> > 
> > On Sat, May 14, 2022 at 2:26 AM Bogdan  wrote:
> > 
> > > Hello, does anybody have a suggestion how to fix the import map editor?
> > > 
> > > On Wed, May 11, 2022, 12:26 Bogdan  wrote:
> > > 
> > > > Hi,
> > > > 
> > > > I've accidentally deleted several accounts in the Import Map Editor -
> > > > Bayesian (actually, I was trying to delete a match string but it would
> > > > delete the entire source account with all match strings). Now,
> > > obviously,
> > > > matching on import no longer works for these accounts.
> > > > 
> > > 
> > > Is there a way to restore it?
> > > 
> > > Making a new import does not record the missing account in the Import Map
> > > > Editor (and match strings are not recorded).
> > > > 
> > > > Thanks!
> > > > 
> > > ___
> > > gnucash-user mailing list
> > > gnucash-user@gnucash.org
> > > To update your subscription preferences or to unsubscribe:
> > > https://lists.gnucash.org/mailman/listinfo/gnucash-user
> > > If you are using Nabble or Gmane, please see
> > > https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
> > > -
> > > Please remember to CC this list on all your replies.
> > > You can do this by using Reply-To-List or Reply-All.
> > > 
> ___
> gnucash-user mailing list
> gnucash-user@gnucash.org
> To update your subscription preferences or to unsubscribe:
> https://lists.gnucash.org/mailman/listinfo/gnucash-user
> If you are using Nabble or Gmane, please see 
> https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
> -
> Please remember to CC this list on all your replies.
> You can do this by using Reply-To-List or Reply-All.

___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
If you are using Nabble or Gmane, please see 
https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.

Re: [GNC] Import Map Editor - accidentally deleted account

[Bogdan]

Hello,

I don't have a "qif-accounts-map" file on my system.  I've been importing
OFX rather than QIF format. Where else would the mapping for these imports
be stored?


On Wed, May 18, 2022 at 1:28 AM Tommy Trussell 
wrote:

> I don't regularly import data, so I am not sure...
>
> HOWEVER what happens if you quit GnuCash, move the qif-accounts-map file
> to another place, then open GnuCash and try the import again?
>
> https://wiki.gnucash.org/wiki/Configuration_Locations
>
> If this is "dangerous" I hope someone jumps in. Since I haven't used the
> importer on this system I don't even see the file, so I presume it gets
> automatically created when necessary during the import process.
>
> Please be sure to report back whether thad does or does not work!
>
>
> On Sat, May 14, 2022 at 2:26 AM Bogdan  wrote:
>
>> Hello, does anybody have a suggestion how to fix the import map editor?
>>
>> On Wed, May 11, 2022, 12:26 Bogdan  wrote:
>>
>> > Hi,
>> >
>> > I've accidentally deleted several accounts in the Import Map Editor -
>> > Bayesian (actually, I was trying to delete a match string but it would
>> > delete the entire source account with all match strings). Now,
>> obviously,
>> > matching on import no longer works for these accounts.
>> >
>>
>> Is there a way to restore it?
>> >
>>
>> Making a new import does not record the missing account in the Import Map
>> > Editor (and match strings are not recorded).
>> >
>> > Thanks!
>> >
>> ___
>> gnucash-user mailing list
>> gnucash-user@gnucash.org
>> To update your subscription preferences or to unsubscribe:
>> https://lists.gnucash.org/mailman/listinfo/gnucash-user
>> If you are using Nabble or Gmane, please see
>> https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
>> -
>> Please remember to CC this list on all your replies.
>> You can do this by using Reply-To-List or Reply-All.
>>
>
___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
If you are using Nabble or Gmane, please see 
https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.

Re: [GNC] Import Map Editor - accidentally deleted account

[Tommy Trussell]

I don't regularly import data, so I am not sure...

HOWEVER what happens if you quit GnuCash, move the qif-accounts-map file to
another place, then open GnuCash and try the import again?

https://wiki.gnucash.org/wiki/Configuration_Locations

If this is "dangerous" I hope someone jumps in. Since I haven't used the
importer on this system I don't even see the file, so I presume it gets
automatically created when necessary during the import process.

Please be sure to report back whether thad does or does not work!


On Sat, May 14, 2022 at 2:26 AM Bogdan  wrote:

> Hello, does anybody have a suggestion how to fix the import map editor?
>
> On Wed, May 11, 2022, 12:26 Bogdan  wrote:
>
> > Hi,
> >
> > I've accidentally deleted several accounts in the Import Map Editor -
> > Bayesian (actually, I was trying to delete a match string but it would
> > delete the entire source account with all match strings). Now, obviously,
> > matching on import no longer works for these accounts.
> >
>
> Is there a way to restore it?
> >
>
> Making a new import does not record the missing account in the Import Map
> > Editor (and match strings are not recorded).
> >
> > Thanks!
> >
> ___
> gnucash-user mailing list
> gnucash-user@gnucash.org
> To update your subscription preferences or to unsubscribe:
> https://lists.gnucash.org/mailman/listinfo/gnucash-user
> If you are using Nabble or Gmane, please see
> https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
> -
> Please remember to CC this list on all your replies.
> You can do this by using Reply-To-List or Reply-All.
>
___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
If you are using Nabble or Gmane, please see 
https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.

Re: [GNC] Import Map Editor - accidentally deleted account

[Bogdan]

Hello, does anybody have a suggestion how to fix the import map editor?

On Wed, May 11, 2022, 12:26 Bogdan  wrote:

> Hi,
>
> I've accidentally deleted several accounts in the Import Map Editor -
> Bayesian (actually, I was trying to delete a match string but it would
> delete the entire source account with all match strings). Now, obviously,
> matching on import no longer works for these accounts.
>

Is there a way to restore it?
>

Making a new import does not record the missing account in the Import Map
> Editor (and match strings are not recorded).
>
> Thanks!
>
___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
If you are using Nabble or Gmane, please see 
https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.

Re: [GNC] import map editor takes a VERY long time to open

[david whiting]

Thanks. I do have a lot of transactions that have a unique reference.

I have one core (of eight) that is running at 100% processing this. It has
now been running for 3 and half hours and the trace file is 557 Mb and
growing...

David

On Sun, 1 Mar 2020 at 21:33, David Cousens  wrote:

> David,
>
> I have a 16.8 Mbyte uncompresseddata file which takes 3-4 sec at most to
> load at startup in V3.8 on Linux Mint 19.3 (Ubuntu 18.04). The Import Map
> Editor comes up almost immediately on selecting it from the menu. I
> possibly
> have fewer accounts than you have and have roughly half the transactions
> and
> splits.
>
> If you have a transaction source (or several of them) which uses a unique
> number each time in the transaction description you can get a lot of import
> matching data being stored with very low frequency of occurrence that
> effectively does little to help with matching. I have 6-8 transactions a
> month which regularly can't be matched because of this. Government
> departments/ pensionfunds  are becoming specialists at tagging UUIDs onto
> things. This of course has to be imported and sorted through during import
> and matching which is probably why you want to use the Import match Editor.
> Unfortunately as the match data is stored in the data file there is no
> simple way to remove it and start again with retraining. I have't yet taken
> the time out to prune the matching data but the ability to do this is
> obviously there for when there is a problem.
>
> If you upload the whole tracefile Geert or John may be able to spot
> something in it but if the excerpt is typical it would appear to be
> buidling
> up the tables of information that the import match editor uses. There may
> be
> nothing for it but to allow it to run to completion. You may ned to turn
> off
> any power saving measures in Ubuntu which automatically hibernate or
> suspend
> the system to allow this to occur.
>
> Linux has a sometimes annoying indexing process which seems to grab a lot
> of
> CPU time and runs with a high priority and can stop other programs from
> operating by denial of service until it is complete (has been several hours
> on a few occasions). This is usually accompanied by a lot of disk access.
> There are fixes on the various  Linux forums if this is the problem.
>
> I seem to remember there may be a bug or feature request around possibly
> parsing such numbers where there is a fixed component which would identify
> a
> specific account and a random component but this is not going to be easy
> unless there is a separator of some sort. I don't know if anyone has looked
> at this yet.
>
> David Cousens
>
>
>
> -
> David Cousens
> --
> Sent from: http://gnucash.1415818.n4.nabble.com/GnuCash-User-f1415819.html
> ___
> gnucash-user mailing list
> gnucash-user@gnucash.org
> To update your subscription preferences or to unsubscribe:
> https://lists.gnucash.org/mailman/listinfo/gnucash-user
> If you are using Nabble or Gmane, please see
> https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
> -
> Please remember to CC this list on all your replies.
> You can do this by using Reply-To-List or Reply-All.
>


-- 
David Whiting
___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
If you are using Nabble or Gmane, please see 
https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.

Re: [GNC] import map editor takes a VERY long time to open

[David Cousens]

David,

I have a 16.8 Mbyte uncompresseddata file which takes 3-4 sec at most to
load at startup in V3.8 on Linux Mint 19.3 (Ubuntu 18.04). The Import Map
Editor comes up almost immediately on selecting it from the menu. I possibly
have fewer accounts than you have and have roughly half the transactions and
splits. 

If you have a transaction source (or several of them) which uses a unique
number each time in the transaction description you can get a lot of import
matching data being stored with very low frequency of occurrence that
effectively does little to help with matching. I have 6-8 transactions a
month which regularly can't be matched because of this. Government
departments/ pensionfunds  are becoming specialists at tagging UUIDs onto
things. This of course has to be imported and sorted through during import
and matching which is probably why you want to use the Import match Editor.
Unfortunately as the match data is stored in the data file there is no
simple way to remove it and start again with retraining. I have't yet taken
the time out to prune the matching data but the ability to do this is
obviously there for when there is a problem.

If you upload the whole tracefile Geert or John may be able to spot
something in it but if the excerpt is typical it would appear to be buidling
up the tables of information that the import match editor uses. There may be
nothing for it but to allow it to run to completion. You may ned to turn off
any power saving measures in Ubuntu which automatically hibernate or suspend
the system to allow this to occur. 

Linux has a sometimes annoying indexing process which seems to grab a lot of
CPU time and runs with a high priority and can stop other programs from
operating by denial of service until it is complete (has been several hours
on a few occasions). This is usually accompanied by a lot of disk access.
There are fixes on the various  Linux forums if this is the problem.

I seem to remember there may be a bug or feature request around possibly
parsing such numbers where there is a fixed component which would identify a
specific account and a random component but this is not going to be easy
unless there is a separator of some sort. I don't know if anyone has looked
at this yet.

David Cousens



-
David Cousens
--
Sent from: http://gnucash.1415818.n4.nabble.com/GnuCash-User-f1415819.html
___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
If you are using Nabble or Gmane, please see 
https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.

Re: [GNC] import map editor

[Justin H Haynes]

> Bayesian matching tokenizes the description on whitespace. Each time you 
> assign a transaction whose description contains a particular token the count 
> on the corresponding token-account pair is incremented (and the token-account 
> pair is created if it doesn’t already exist). There’s no filtering applied to 
> the tokens; that might be a useful enhancement. 
> 
> Matching is accomplished by finding all of the token-account pairs matching 
> the tokens in the transaction’s description and then summing the counts by 
> account. The account with the highest sum is assigned as the match. 
> 
> Regards, 
> John Ralls 

Based on this explanation, and on the FAQ question about “How do I get the most 
benefit from the Bayesian learning algorithm while importing?” 
(https://wiki.gnucash.org/wiki/FAQ#Q:_How_do_I_get_the_most_benefit_from_the_Bayesian_learning_algorithm_while_importing.3F
 
),
 and on the fact that when I started with GNUCash I ignored the import dialog 
because I found entering the account information into the register after import 
to be faster than using the import dialog; I should delete *all* the Beyesian 
information in the import dialog for all accounts.

My understanding is that I have an invalid set of data, because I have broken a 
fundamental assumption - the human has correctly mapped transactions to 
accounts.

I imported easily 100s of transactions without mapping.

Thanks!,

Justin
___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
If you are using Nabble or Gmane, please see 
https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.

Re: [GNC] import map editor

[John Ralls]

> On May 12, 2018, at 9:46 AM, Eric Theise  wrote:
> 
> Thank for answering my questions, Geert.
> 
> On Sat, May 12, 2018 at 6:21 AM Geert Janssens 
> wrote:
> 
>> Do let us know if the import behaves better after you have removed the bad
>> map
>> entries.
>> 
> 
> I only import into each account on a monthly basis so it'll take some time
> to really answer this. For the account I reconciled yesterday I deleted
> many dozens of entries; there were only two that looked correct. As I noted
> in the ticket, there were many cases where account names appeared in the
> Match String which, sans documentation, seems very suspicious to me.
> 
> Many of the new entries for that account look promising but I wish it
> wouldn't create entries for day names. I can see use cases for that feature
> but in my case, day names are noise. There are many one & two character &
> digit Match Strings which will also be noise.
> 
> I wonder if the Non-Bayesian is better for me and if there are paths to
> creating rules. I do wonder if Bayesian and Non-Bayesian can be in use at
> the same time.
> 
> Oops, as I go to look the Preferences window locks up. Time for a different
> ticket.
> 

Bayesian matching tokenizes the description on whitespace. Each time you assign 
a transaction whose description contains a particular token the count on the 
corresponding token-account pair is incremented (and the token-account pair is 
created if it doesn’t already exist). There’s no filtering applied to the 
tokens; that might be a useful enhancement.

Matching is accomplished by finding all of the token-account pairs matching the 
tokens in the transaction’s description and then summing the counts by account. 
The account with the highest sum is assigned as the match. 

Regards,
John Ralls



___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
If you are using Nabble or Gmane, please see 
https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.

Re: [GNC] import map editor

[Eric Theise]

Thank for answering my questions, Geert.

On Sat, May 12, 2018 at 6:21 AM Geert Janssens 
wrote:

> Do let us know if the import behaves better after you have removed the bad
> map
> entries.
>

I only import into each account on a monthly basis so it'll take some time
to really answer this. For the account I reconciled yesterday I deleted
many dozens of entries; there were only two that looked correct. As I noted
in the ticket, there were many cases where account names appeared in the
Match String which, sans documentation, seems very suspicious to me.

Many of the new entries for that account look promising but I wish it
wouldn't create entries for day names. I can see use cases for that feature
but in my case, day names are noise. There are many one & two character &
digit Match Strings which will also be noise.

I wonder if the Non-Bayesian is better for me and if there are paths to
creating rules. I do wonder if Bayesian and Non-Bayesian can be in use at
the same time.

Oops, as I go to look the Preferences window locks up. Time for a different
ticket.

Eric
___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
If you are using Nabble or Gmane, please see 
https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.

Re: [GNC] import map editor

[Geert Janssens]

Op vrijdag 11 mei 2018 23:10:34 CEST schreef Eric Theise:
> I appreciate Stefan raising this issue. I have the opposite issue; not an
> empty editor, but an editor full of "Map Account NOT found" and
> "Unspecified" lines. Geert Janssens suggested that my import maps have been
> corrupted as the most recent comment in my bug filed at
> https://bugzilla.gnome.org/show_bug.cgi?id=794690 and, having just
> installed 3.1.3, I'd like to make a go of fixing them.
> 
> A few questions.
> 
> * is there documentation somewhere that explains the format of the "Match
> String" and what it's matched against?

I don't know this part.

> * is there any reason not to delete the dozens of lines whose "Mapped to
> Account Name" is "Map Account NOT found"?

No, you can safely delete them. These won't we helpful in matching anyway.

> * is there any reason not to delete the dozens of lines whose "Mapped to
> Account Name" is "Unspecified"?

Same here;

> * is there any way to edit, as opposed to delete, a line or am I expecting
> too much of the "Import Map Editor"?

That's too much :(
The import map editor was designed to remove bad import map entries, so they 
wouldn't interfere with future imports any more.

Do let us know if the import behaves better after you have removed the bad map 
entries.

Geert


___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
If you are using Nabble or Gmane, please see 
https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.

Re: [GNC] import map editor

[Geert Janssens]

Op maandag 9 april 2018 09:50:37 CEST schreef Stefan Mueller:
> Hallo all,
> can anyone explain the purpose of the "import map editor" shown in the
> tools menu?
> All what I can find related to mapping imports is this:
> https://wiki.gnucash.org/wiki/Bayes
> http://gnucash.1415818.n4.nabble.com/Fixing-confused-bayesian
> -matching-data-td4685819.html
> but there is nothing about the editor.
> 
> Can anyone explain how to use it is still empty after several csv imports.
> 
> Thank you
> 
> Stefan


The import map editor allows you to delete bad mappings between strings in 
your import data and accounts in gnucash. So if you made a mistake while 
mapping you can correct it here. "Correct" in the sense that you can make 
gnucash forget the bad mapping. It will only learn new mappings during 
imports.

As for the maps being empty:
- do you have bayesian mapping enabled ?
- do you actually do matching while importing ? That is in the import 
assistant at some point you get a list of transactions colored green, yellow 
or red. Double clicking on the yellow and red transactions allows you to 
complete them. This is crucial to build mapping data.

Regards,

Geert


___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
If you are using Nabble or Gmane, please see 
https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.

Re: [GNC] import map editor

[Eric Theise]

I appreciate Stefan raising this issue. I have the opposite issue; not an
empty editor, but an editor full of "Map Account NOT found" and
"Unspecified" lines. Geert Janssens suggested that my import maps have been
corrupted as the most recent comment in my bug filed at
https://bugzilla.gnome.org/show_bug.cgi?id=794690 and, having just
installed 3.1.3, I'd like to make a go of fixing them.

A few questions.

* is there documentation somewhere that explains the format of the "Match
String" and what it's matched against?
* is there any reason not to delete the dozens of lines whose "Mapped to
Account Name" is "Map Account NOT found"?
* is there any reason not to delete the dozens of lines whose "Mapped to
Account Name" is "Unspecified"?
* is there any way to edit, as opposed to delete, a line or am I expecting
too much of the "Import Map Editor"?

Thanks, Eric


On Mon, Apr 9, 2018 at 12:53 AM Stefan Mueller 
wrote:

> Hallo all,
> can anyone explain the purpose of the "import map editor" shown in the
> tools menu?
> All what I can find related to mapping imports is this:
> https://wiki.gnucash.org/wiki/Bayes
> http://gnucash.1415818.n4.nabble.com/Fixing-confused-bayesian
> -matching-data-td4685819.html
> but there is nothing about the editor.
>
> Can anyone explain how to use it is still empty after several csv imports.
>
> Thank you
>
> Stefan
> ___
> gnucash-user mailing list
> gnucash-user@gnucash.org
> To update your subscription preferences or to unsubscribe:
> https://lists.gnucash.org/mailman/listinfo/gnucash-user
> If you are using Nabble or Gmane, please see
> https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
> -
> Please remember to CC this list on all your replies.
> You can do this by using Reply-To-List or Reply-All.
>
___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
If you are using Nabble or Gmane, please see 
https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.