Martin Michlmayr

Research on FOSS foundations

Martin Michlmayr — Wed, 28 Apr 2021 08:29:27 GMT

I worked on research on FOSS foundations and published two reports:

Growing Open Source Projects with a Stable Foundation

This primer covers non-technical aspects that the majority of projects will have to consider at some point. It also explains how FOSS foundations can help projects grow and succeed.

This primer explains:

What issues and areas to consider
How other projects and foundations have approached these topics
What FOSS foundations bring to the table
How to choose a FOSS foundation

You can download Growing Open Source Projects with a Stable Foundation.

Research report

The research report describes the findings of the research and aims to help understand the operations and challenges FOSS foundations face.

This report covers topics such as:

Role and activities of foundations
Challenges faced and gaps in the service offerings
Operational aspects, including reasons for starting an org and choice of jurisdiction
Trends, such as the "foundation in a foundation" model
Recommendations for different stakeholders

You can download the research report.

Acknowledgments

This research was sponsored by Ford Foundation and Alfred P. Sloan Foundation. The research was part of their Critical Digital Infrastructure Research initiative, which investigates the role of open source in digital infrastructure.

ledger2beancount 2.6 released

Martin Michlmayr — Thu, 15 Apr 2021 05:18:30 GMT

I released version 2.6 of ledger2beancount, a ledger to beancount converter.

Here are the changes in 2.6:

Round calculated total if needed for price==cost comparison
Add narration_tag config variable to set narration from metadata
Retain unconsummated payee/payer metadata
Ensure UTF-8 output and assume UTF-8 input
Document UTF-8 issue on Windows systems
Add option to move posting-level tags to the transaction itself
Add support for the alias sub-directive of account declarations
Add support for the payee sub-directive of account declarations
Support configuration file called .ledger2beancount.yaml
Fix uninitialised value warning in hledger mode
Print warning if account in assertion has sub-accounts
Set commodity for commodity-less balance assertion
Expand path name of beancount_header config variable
Document handling of buckets
Document pre- and post-processing examples
Add Dockerfile to create Docker image

Thanks to Alexander Baier, Daniele Nicolodi, and GitHub users bratekarate, faaafo and mefromthepast for various bug reports and other input.

Thanks to Dennis Lee for adding a Dockerfile and to Vinod Kurup for fixing a bug.

Thanks to Stefano Zacchiroli for testing.

You can get ledger2beancount from GitHub.

beancount2ledger 1.3 released

Martin Michlmayr — Fri, 13 Nov 2020 12:12:16 GMT

I released version 1.3 of beancount2ledger, the beancount to ledger converter that was moved from bean-report ledger into a standalone tool.

You can get beancount2ledger from GitHub or via pip install.

Here are the changes in 1.3:

Add rounding postings only when required (issue #9)
Avoid printing too much precision for a currency (issue #21)
Avoid creating two or more postings with null amount (issue #23)
Add price to cost when needed by ledger (issue #22)
Preserve posting order (issue #18)
Add config option indent
Show metadata with hledger output
Support setting auxiliary dates and posting dates from metadata (issue #14)
Support setting the code of transactions from metadata
Support mapping of account and currency names (issue #24)
Improve documentation:
- Add user guide
- Document limitations (issue #12)

ledger2beancount 2.5 released

Martin Michlmayr — Tue, 03 Nov 2020 07:52:18 GMT

I released version 2.5 of ledger2beancount, a ledger to beancount converter.

Here are the changes in 2.5:

Don't create negative cost for lot without cost
Support complex implicit conversions
Handle typed metadata with value 0 correctly
Set per-unit instead of total cost when cost is missing from lot
Support commodity-less amounts
Convert transactions with no amounts or only 0 amounts to notes
Fix parsing of transaction notes
Keep tags in transaction notes on same line as transaction header
Add beancount config options for non-standard root names automatically
Fix conversion of fixated prices to costs
Fix removal of price when price==cost but when they use different number formats
Fix removal of price when price==cost but per-unit and total notation mixed
Fix detection of tags and metadata after posting/aux date
Use D directive to set default commodity for hledger
Improve support for postings with commodity-less amounts
Allow empty comments
Preserve leading whitespace in comments in postings and transaction headers
Preserve indentation for tags and metadata
Preserve whitespace between amount and comment
Refactor code to use more data structures
Remove dependency on Config::Onion module

Thanks to input from Remco Rĳnders, Yuri Khan, and Thierry. Thanks to Stefano Zacchiroli and Kirill Goncharov for testing my changes.

You can get ledger2beancount from GitHub

ledger2beancount 2.4 released

Martin Michlmayr — Mon, 27 Jul 2020 08:07:57 GMT

I released version 2.4 of ledger2beancount, a ledger to beancount converter.

There are two notable changes in this release:

I fixed two regressions introduced in the last release. Sorry about the breakage!
I improved support for hledger. I believe all syntax differences in hledger are supported now.

Here are the changes in 2.4:

Fix regressions introduced in version 2.3
- Handle price directives with comments
- Don't assume implicit conversion when price is on second posting
Improve support for hledger
- Fix parsing of hledger tags
- Support commas as decimal markers
- Support digit group marks through commodity and D directives
- Support end aliases directive
- Support regex aliases
- Recognise total balance assertions
- Recognise sub-account balance assertions
Add support for define directive
Convert all uppercase metadata tags to all lowercase
Improve handling of ledger lots without cost
Allow transactions without postings
Fix parsing issue in commodity declarations
Support commodities that contain quotation marks
Add --version option to show version
Document problem of mixing apply and include

Thanks to Kirill Goncharov for pointing out one regressions, to Taylor R Campbell for for a patch, to Stefano Zacchiroli for some input, and finally to Simon Michael for input on hledger!

You can get ledger2beancount from GitHub

beancount2ledger 1.1 released

Martin Michlmayr — Fri, 24 Jul 2020 07:04:56 GMT

Martin Blais recently announced that he'd like to re-organize the beancount code and split out some functionality into separate projects, including the beancount to ledger/hledger conversion code previously provided by bean-report.

I agreed to take on the maintenance of this code and I've now released beancount2ledger, a beancount to ledger/hledger converter.

You can install beancount2ledger with pip:

pip3 install beancount2ledger

Please report issues to the GitHub tracker.

There are a number of outstanding issues I'll fix soon, but please report any other issues you encounter.

Note that I'm not very familiar with hledger. I intend to sync up with hledger author Simon Michael soon, but please file an issue if you notice any problems with the hledger conversion.

Version 1.1 contains a number of fixes compared to the latest code in bean-report:

1.1 (2020-07-24)

Preserve metadata information (issue #3)
Preserve cost information (lot dates and lot labels/notes) (issue #5)
Avoid adding two prices in hledger (issue #2)
Avoid trailing whitespace in account open declarations (issue #6)
Fix indentation issue in postings (issue #8)
Fix indentation issue in price entries
Drop time information from price (P) entries
Add documentation
Relicense under GPL-2.0-or-later (issue #1)

1.0 (2020-07-22)

Split ledger and hledger conversion from bean-report into a standalone tool
Add man page for beancount2ledger(1)

ledger2beancount 2.3 released

Martin Michlmayr — Fri, 26 Jun 2020 03:45:29 GMT

I released version 2.3 of ledger2beancount, a ledger to beancount converter.

There are three notable changes with this release:

Performance has significantly improved. One large, real-world test case has gone from around 160 seconds to 33 seconds. A smaller test case has gone from 11 seconds to ~3.5 seconds.
The documentation is available online now (via Read the Docs).
The repository has moved to the beancount GitHub organization.

Here are the changes in 2.3:

Improve speed of ledger2beancount significantly
Improve parsing of postings for accuracy and speed
Improve support for inline math
Handle lots without cost
Fix parsing of lot notes followed by a virtual price
Add support for lot value expressions
Make parsing of numbers more strict
Fix behaviour of dates without year
Accept default ledger date formats without configuration
Fix implicit conversions with negative prices
Convert implicit conversions in a more idiomatic way
Avoid introducing trailing whitespace with hledger input
Fix loading of config file
Skip ledger directive import
Convert documentation to mkdocs

Thanks to Colin Dean for some feedback. Thanks to Stefano Zacchiroli for prompting me into investigating performance issues (and thanks to the developers of the Devel::NYTProf profiler).

You can get ledger2beancount from GitHub