generic-poky/bitbake
Haris Okanovic 4a12865c7b bitbake: prserv: Add dump_db()
Returns a script (string) that reconstructs the state of the
entire database at the time this function is called. The script
language is defined by the backing database engine, which is a
function of server configuration.
Returns None if the database engine does not support dumping to
script or if some other error is encountered in processing.

The SQLite3 implementation in db.py calls iterdump() [1] to generate
a script. iterdump() is the library equivalent of the `sqlite3 .dump`
shell command, and the scripts are compatible. Execute the script in
an empty SQLite3 database using the sqlite3 utility to restore a backup
of prserv.

Use case: Backup a live PR server database in a non-racy way, such
that one could snapshot the entire database after a set of bitbake
builds all using a shared server. I.e. All changes made prior to
the start of a dump_db() operation should be committed and captured
in the script. Subsequent changes made during the backup process are
not guaranteed to be captured.

Testing: ~7MB database backs up in ~1s while PR server is under load
from 32 thread bitbake builds on two separate machines.

[1] https://docs.python.org/2/library/sqlite3.html#sqlite3.Connection.iterdump

(Bitbake rev: 004003daf6bd0f0233ce5c2d95f1d7d64ab91bb3)

Signed-off-by: Haris Okanovic <haris.okanovic@ni.com>
Reviewed-by: Ken Sharp <ken.sharp@ni.com>
Reviewed-by: Bill Pittman <bill.pittman@ni.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-02-26 17:20:31 +00:00
..
bin bitbake: Bump version post release to 1.29.0 2016-02-12 13:44:22 +00:00
contrib bitbake: newbb.vim: remove PR 2014-08-19 20:41:26 +01:00
doc bitbake: bitbake-user-manual-ref-variables: Update the help for BBMASK 2016-01-29 17:03:53 +00:00
lib bitbake: prserv: Add dump_db() 2016-02-26 17:20:31 +00:00
AUTHORS misc: Update the email address to a working one. 2011-01-04 14:36:54 +00:00
COPYING bitbake: Sync with upstream. 2007-01-08 23:53:01 +00:00
ChangeLog *: Fix typo in documentation 2010-08-04 16:12:39 +01:00
HEADER bitbake: Sync with upstream. 2007-01-08 23:53:01 +00:00
LICENSE bitbake: toaster: adding frameworks for the Simple UI 2013-10-18 11:13:49 +01:00
toaster-requirements.txt bitbake: toaster: rework checking of Django version 2015-12-14 23:13:08 +00:00