ledger-autosync: CSV support

[Erik Hetzner]

Hi all,

I have added some basic CSV support to ledger-autosync. It has not been released
on pypi, but is available currently via source on gitlab and github.

The features works much like the existing OFX file support in ledger-autosync.
ledger-autosync is invoked with a command line argument of a file path, and
ledger-autosync prints a series of ledger transactions to stdout.

The advantage ledger-autosync has over other CSV to ledger converters is the
deduplication features. For CSV files which include a unique ID per row, the
transactions will be deduplicated similarly to the existing feature for OFX
files. For CSV formats that do not include a unique per row, an MD5 sum will be
generated from the row content which will be used to deduplicate.

For the moment, I have only added support for Paypal, Amazon and Mint CSV
formats, as this is all I had available. However, it should be easy enough for
developers to add support for new CSV formats. Examples of converters can be 
found here:

  
https://gitlab.com/egh/ledger-autosync/blob/master/ledgerautosync/converter.py#L316

I hope that this proves helpful! Feedback welcome. The source is available at
gitlab and github:

  https://{gitlab,github}.com/egh/ledger-autosync

I have also recently been working on the 401k and investment features of
ledger-autosync, which are not pretty robust, if largely undocumented. Anyone
who is not currently tracking their 401k via ledger is encouraged to give it a
try!

best, Erik

--
Sent from my free software system .

-- 

--- 
You received this message because you are subscribed to the Google Groups 
"Ledger" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to ledger-cli+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: Moving ledger-mode out of the main ledger repository

[Jacob MacDonald]

I would suggest just using semver, treating a bump of the required Ledger
version as a breaking change and noting the minimum required Ledger version
in the release notes. I'm saying this with no knowledge of whether Ledger
likes semver or has a problem with unsynchronized version numbers/large
major versions :-).

On Tue, Aug 2, 2016 at 6:21 PM David Glasser 
wrote:

> Having a tight coupling between ledger and ledger-mode versions would have
> been a problem even when they were in the same repo, since there's not much
> to encourage users to make sure to carefully upgrade them simultaneously.
>
> On Tue, Aug 2, 2016 at 5:18 PM, Craig Earls  wrote:
>
>> I will use a separate version number. Up to this point there hasnt been
>> one they are very loosely coupled. I am open to suggestions.   Ledger mode
>> is mostly getting bug fixes no features have been added in a few years now.
>>
>> On Tuesday, August 2, 2016, Ben Finney <
>> bignose+hates-s...@benfinney.id.au> wrote:
>>
>>> "John Wiegley"  writes:
>>>
>>> > > "BF" == Ben Finney  writes:
>>> >
>>> > BF> Are you de-coupling the release cycles, or will ‘ledger’ and
>>> > BF> ‘ledger-mode’ still track the same version and release at the same
>>> > BF> time? How will that be managed?
>>> >
>>> > They don't need to be exactly synced
>>>
>>> So, my question was based on the assumption that until now they are both
>>> on a single release cycle, and both have an identical version at all
>>> times. Is that assumption correct?
>>>
>>> > unless there is a change in the data protocol used between them, or in
>>> > the reporting arguments. But all of that is very stable now.
>>>
>>> When the split occurs, will the versions mean what they do today by
>>> remaining in lock-step at each release? Or will they diverge?
>>>
>>> --
>>>  \   “Everyone is entitled to their own opinions, but they are not |
>>>   `\entitled to their own facts.” —US Senator Pat Moynihan |
>>> _o__)  |
>>> Ben Finney
>>>
>>> --
>>>
>>> ---
>>> You received this message because you are subscribed to the Google
>>> Groups "Ledger" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to ledger-cli+unsubscr...@googlegroups.com.
>>> For more options, visit https://groups.google.com/d/optout.
>>>
>>
>>
>> --
>> Craig, Corona De Tucson, AZ
>> enderw88.wordpress.com
>>
>> --
>>
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "Ledger" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to ledger-cli+unsubscr...@googlegroups.com.
>> For more options, visit https://groups.google.com/d/optout.
>>
>
>
>
> --
> glas...@davidglasser.net | langtonlabs.org | flickr.com/photos/glasser/
>
> --
>
> ---
> You received this message because you are subscribed to the Google Groups
> "Ledger" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to ledger-cli+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>

-- 

--- 
You received this message because you are subscribed to the Google Groups 
"Ledger" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to ledger-cli+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: Moving ledger-mode out of the main ledger repository

[Ben Finney]

"John Wiegley"  writes:

> > "BF" == Ben Finney  writes:
>
> BF> Are you de-coupling the release cycles, or will ‘ledger’ and
> BF> ‘ledger-mode’ still track the same version and release at the same
> BF> time? How will that be managed?
>
> They don't need to be exactly synced

So, my question was based on the assumption that until now they are both
on a single release cycle, and both have an identical version at all
times. Is that assumption correct?

> unless there is a change in the data protocol used between them, or in
> the reporting arguments. But all of that is very stable now.

When the split occurs, will the versions mean what they do today by
remaining in lock-step at each release? Or will they diverge?

-- 
 \   “Everyone is entitled to their own opinions, but they are not |
  `\entitled to their own facts.” —US Senator Pat Moynihan |
_o__)  |
Ben Finney

-- 

--- 
You received this message because you are subscribed to the Google Groups 
"Ledger" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to ledger-cli+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: Moving ledger-mode out of the main ledger repository

[John Wiegley]

> "CE" == Craig Earls  writes:

CE> Works for me. As far as synchronizing releases there isnt much necessary.
CE> Unless the interface changes ledger-mode is happy with 3.x version.

Ok, we now have a new repository under the Ledger organization:

https://github.com/ledger/ledger-mode

I have also remove the lisp/ directory from the ledger project, although I
have a feeling CMake is going to need to be told too...

-- 
John Wiegley  GPG fingerprint = 4710 CF98 AF9B 327B B80F
http://newartisans.com  60E1 46C4 BD1A 7AC1 4BA2

-- 

--- 
You received this message because you are subscribed to the Google Groups 
"Ledger" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to ledger-cli+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Moving ledger-mode out of the main ledger repository

[Craig Earls]

Works for me. As far as synchronizing releases there isnt much necessary.
Unless the interface changes ledger node is happy with 3.x version.

On Tuesday, August 2, 2016, Ben Finney >
wrote:

> "John Wiegley" 
> writes:
>
> > Just wanted to let you know that I'll be splitting ledger-mode and the
> > Emacs code into its own repository within the ledger organization on
> > GitHub soon.
>
> Are you de-coupling the release cycles, or will ‘ledger’ and
> ‘ledger-mode’ still track the same version and release at the same time?
> How will that be managed?
>
> --
>  \“It is always a silly thing to give advice, but to give good |
>   `\   advice is absolutely fatal.” —Oscar Wilde, _The Portrait of Mr. |
> _o__)  W. H._, 1889-07 |
> Ben Finney
>
> --
>
> ---
> You received this message because you are subscribed to the Google Groups
> "Ledger" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to ledger-cli+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>


-- 
Craig, Corona De Tucson, AZ
enderw88.wordpress.com

-- 

--- 
You received this message because you are subscribed to the Google Groups 
"Ledger" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to ledger-cli+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: Moving ledger-mode out of the main ledger repository

[Craig Earls]

Works for me. As far as synchronizing releases there isnt much necessary.
Unless the interface changes ledger-mode is happy with 3.x version.

On Tuesday, August 2, 2016, Ben Finney 
wrote:

> "John Wiegley" >
> writes:
>
> > Just wanted to let you know that I'll be splitting ledger-mode and the
> > Emacs code into its own repository within the ledger organization on
> > GitHub soon.
>
> Are you de-coupling the release cycles, or will ‘ledger’ and
> ‘ledger-mode’ still track the same version and release at the same time?
> How will that be managed?
>
> --
>  \“It is always a silly thing to give advice, but to give good |
>   `\   advice is absolutely fatal.” —Oscar Wilde, _The Portrait of Mr. |
> _o__)  W. H._, 1889-07 |
> Ben Finney
>
> --
>
> ---
> You received this message because you are subscribed to the Google Groups
> "Ledger" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to ledger-cli+unsubscr...@googlegroups.com .
> For more options, visit https://groups.google.com/d/optout.
>


-- 
Craig, Corona De Tucson, AZ
enderw88.wordpress.com

-- 

--- 
You received this message because you are subscribed to the Google Groups 
"Ledger" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to ledger-cli+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: Moving ledger-mode out of the main ledger repository

[John Wiegley]

> "BF" == Ben Finney  writes:

BF> Are you de-coupling the release cycles, or will ‘ledger’ and
BF> ‘ledger-mode’ still track the same version and release at the same time?
BF> How will that be managed?

They don't need to be exactly synced, unless there is a change in the data
protocol used between them, or in the reporting arguments. But all of that is
very stable now.

-- 
John Wiegley  GPG fingerprint = 4710 CF98 AF9B 327B B80F
http://newartisans.com  60E1 46C4 BD1A 7AC1 4BA2

-- 

--- 
You received this message because you are subscribed to the Google Groups 
"Ledger" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to ledger-cli+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: Moving ledger-mode out of the main ledger repository

[Ben Finney]

"John Wiegley" 
writes:

> Just wanted to let you know that I'll be splitting ledger-mode and the
> Emacs code into its own repository within the ledger organization on
> GitHub soon.

Are you de-coupling the release cycles, or will ‘ledger’ and
‘ledger-mode’ still track the same version and release at the same time?
How will that be managed?

-- 
 \“It is always a silly thing to give advice, but to give good |
  `\   advice is absolutely fatal.” —Oscar Wilde, _The Portrait of Mr. |
_o__)  W. H._, 1889-07 |
Ben Finney

-- 

--- 
You received this message because you are subscribed to the Google Groups 
"Ledger" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to ledger-cli+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: Moving ledger-mode out of the main ledger repository

[Alexis]

Much in favor of this :)

-- 

--- 
You received this message because you are subscribed to the Google Groups 
"Ledger" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to ledger-cli+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: Moving ledger-mode out of the main ledger repository

[Alexandre Rademaker]

1+ agree ! It makes sense!

Sent from my iPhone

> On 2 de ago de 2016, at 19:03, Jacob MacDonald  wrote:
> 
> Big fan of the change! I'll be on the lookout for it as I pull it myself 
> instead of using MELPA.
> 
>> On Tue, Aug 2, 2016 at 3:21 PM John Wiegley  wrote:
>> Hi guys,
>> 
>> Just wanted to let you know that I'll be splitting ledger-mode and the Emacs
>> code into its own repository within the ledger organization on GitHub soon.
>> 
>> If anyone has any concerns or issues, please let me know. The initial goal is
>> to reduce Travis activity due to frequent changes in ledger-mode, which can't
>> affect the Travis results.
>> 
>> John
>> 
>> --
>> 
>> ---
>> You received this message because you are subscribed to the Google Groups 
>> "Ledger" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to ledger-cli+unsubscr...@googlegroups.com.
>> For more options, visit https://groups.google.com/d/optout.
> 
> -- 
> 
> --- 
> You received this message because you are subscribed to the Google Groups 
> "Ledger" group.
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to ledger-cli+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.

-- 

--- 
You received this message because you are subscribed to the Google Groups 
"Ledger" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to ledger-cli+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: Moving ledger-mode out of the main ledger repository

[Jacob MacDonald]

Big fan of the change! I'll be on the lookout for it as I pull it myself
instead of using MELPA.

On Tue, Aug 2, 2016 at 3:21 PM John Wiegley  wrote:

> Hi guys,
>
> Just wanted to let you know that I'll be splitting ledger-mode and the
> Emacs
> code into its own repository within the ledger organization on GitHub soon.
>
> If anyone has any concerns or issues, please let me know. The initial goal
> is
> to reduce Travis activity due to frequent changes in ledger-mode, which
> can't
> affect the Travis results.
>
> John
>
> --
>
> ---
> You received this message because you are subscribed to the Google Groups
> "Ledger" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to ledger-cli+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>

-- 

--- 
You received this message because you are subscribed to the Google Groups 
"Ledger" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to ledger-cli+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Moving ledger-mode out of the main ledger repository

[John Wiegley]

Hi guys,

Just wanted to let you know that I'll be splitting ledger-mode and the Emacs
code into its own repository within the ledger organization on GitHub soon.

If anyone has any concerns or issues, please let me know. The initial goal is
to reduce Travis activity due to frequent changes in ledger-mode, which can't
affect the Travis results.

John

-- 

--- 
You received this message because you are subscribed to the Google Groups 
"Ledger" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to ledger-cli+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.