This is a read only archive of pad.okfn.org. See the shutdown announcement for details.

openspending-dev-meetings ## Dev Meeting - 6 March 2014

Place online on IRC on #openspending on freenode http://webchat.freenode.net/?channels=openspending

### Proposed Agenda

General: Review all high priority issues: https://github.com/openspending/openspending/issues?labels=Priority%3A+High

* Updates on done stuff w00t!
* Solr
    * Solr has been giving us some problems and OpenSpending doesn't fail gracefully. It just fails. That's not good because instead of showing at least an error message, users just get "errors" which isn't helpful.
    * How should we fix this?
        * Graceful fails
        * Identify cause of memory problems (maybe bad queries)
        * Look at how we implement Solr now
    * This is being tracked in https://github.com/openspending/openspending/issues/779
* Documentation: https://github.com/openspending/openspending/issues/736
* Update on OpenSpending Data Package work: https://github.com/openspending/openspending/issues/731
* Regular sprint afternoons / evenings (1/2 per month) ...
* Dev meetings
    * This will be our 12th monthly developer meeting. That's a pretty good trial period. Should we continue? If so, how could we improve them?




## Dev Meeting - 9 Jan 2014

Place: online on IRC on #openspending on freenode http://webchat.freenode.net/?channels=openspending

### Agenda

1. OpenSpending ecosystem
    * Last month there was a a lot of discussion about OS-Upload
    * Some confusion about whether OS-Upload should be standalone or not
    * Let's finish that discussion
    * Let's also decide if we want an ecosystem of tools or as few tools
as possible
2. D3 in OpenSpendingJS
    * Our community works a lot with D3 but OpenSpending doesn't use it
    * Time to move from browser compatibility to community compatibility?
3. Review issue list https://github.com/openspending/openspending/issues?direction=desc&labels=Priority%3A+High
4. Next sprint



#### Migration - https://github.com/openspending/openspending/issues/738

What we have:
    
- s096.okserver.org = RDBMS + SOLR, Celery tasks (e.g. imports)
- s095.okserver.org = frontend

New DB machine = hosted postgres at amazon

Overall steps:

0. Plan
1. DB migration OS.org
2. SOLR migration OS.org
3. Celery migration OS.org
4. Frontend migration OS.org
5. DB migration FarmSubsidy
6. Frontend migration Farmsubsidy

Plan [0.25d]

* Read up on Farmsubsidy
* Contact Stefan re FS.org on-list

Steps for DB migration [1d]

1. Boot new Amazon DB machine
2. Put out notice on lists
3. Put OS.org DB into read-only and put up notice
4. Do dump from DB old or copy to a new instance using Joel's setup for backups
5. Load into DB new
6. Change frontend to point to DB new
7. Change celery to point to DB new
7. Notify list that read-only mode is lifted

Repeat for Farmsubsidy [0.5d?]

[[ tbd?? Prep: new solr config (bad configurations now) ]]

Steps for SOLR migration [0.25d]

1. Boot new SOLR machine (with new config??)
2. Put out notice to lists that search may be b0rked
3. Switch frontend solr to new solr (will be empty)
4. Switch celery to new solr
5. Start re-index
6. Notify lists re-index is complete

Celery migration [0.5d]

1. Will be located on SOLR machine
2. Boot up
3. Change frontend to point to new 
4. Check old queue is empty and shut down 
5. Shut down machine (now solr and celery and DB are gone)

Frontend OS.org migration [0.25d?]

1. Deploy machine
2. Install (and deploy at new.openspending.org or s0xxx.okserver.org and openspending.org)
3. Test new.openspending.org
4. Notify list ok
5. Change DNS
6. Notify list all ok

Repeat for Farmsubsidy [0.25d]


Finally: Shut down and archive frontend machine


## Dev Meeting - 12 Dec 2013

Place: online on IRC on #openspending on freenode http://webchat.freenode.net/?channels=openspending

### Agenda:
    
1. Documentation
    * We have documentation in a few places now, should we combine?
    * How do we keep documentation up to date in separate systems?
    * Do we need to improve the documentation (and how)?

2. Translation process
    * We have a lot of untranslated strings now, how do we get more
translations?
    * How do we fit translations into our current work flow (with no
versions)?

3. OS-Upload
    * Introduction of OS-Upload and how it fits into the project
    * How is progress?
    
4.  Hosting and Infrastructure

5. Federation or centralised

6. SEO work

7. Next sprint
    
6. AOB
- is this priority high issue resolved https://github.com/openspending/openspending/issues/714

### Notes

Will be in irc