sysmo-bts
/
generic-poky
9
0
Fork 0
Code Pull Requests Releases Activity
generic-poky/meta/classes/distrodata.bbclass

486 lines
18 KiB
Plaintext
Raw Normal View History

DistroData: add eventhandler to correctly setup log file Signed-off-by: Saul Wold <Saul.Wold@intel.com>
2010-08-27 02:48:26 +00:00
addhandler distro_eventhandler
classes/conf: Add eventmasks for event handlers Now that bitbake supports masking events for event handlers, lets use this so event handlers are only called for events they care about. This lets us simplify the code indentation a bit at least as well as mildly improving the event handling performance. (From OE-Core rev: bff73743280f9eafebe4591f7368ead91a4eb74d) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2013-06-12 16:31:57 +00:00
distro_eventhandler[eventmask] = "bb.event.BuildStarted"
DistroData: add eventhandler to correctly setup log file Signed-off-by: Saul Wold <Saul.Wold@intel.com>
2010-08-27 02:48:26 +00:00
python distro_eventhandler() {
classes/conf: Add eventmasks for event handlers Now that bitbake supports masking events for event handlers, lets use this so event handlers are only called for events they care about. This lets us simplify the code indentation a bit at least as well as mildly improving the event handling performance. (From OE-Core rev: bff73743280f9eafebe4591f7368ead91a4eb74d) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2013-06-12 16:31:57 +00:00
import oe.distro_check as dc
logfile = dc.create_log_file(e.data, "distrodata.csv")
lf = bb.utils.lockfile("%s.lock" % logfile)
f = open(logfile, "a")
f.write("Package,Description,Owner,License,VerMatch,Version,Upsteam,Reason,Recipe Status,Distro 1,Distro 2,Distro 3\n")
f.close()
bb.utils.unlockfile(lf)
distrodata: Modify Distro tracking spreadsheet Signed-off-by: Saul Wold <Saul.Wold@intel.com>
2010-10-15 20:51:33 +00:00
classes: Drop Handled/NotHandled eventhandler keywords, they don't do anything Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-12-30 18:40:32 +00:00
return
DistroData: add eventhandler to correctly setup log file Signed-off-by: Saul Wold <Saul.Wold@intel.com>
2010-08-27 02:48:26 +00:00
}
DistroData: Cleanup Version numbers and add DistroData Parser Signed-off-by: Saul Wold <Saul.Wold@intel.com>
2010-08-16 21:22:09 +00:00
addtask distrodata_np
do_distrodata_np[nostamp] = "1"
python do_distrodata_np() {
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
localdata = bb.data.createCopy(d)
Convert to use direct access to the data store (instead of bb.data.*Var*()) This is the result of running the following over the metadata: sed \ -e 's:bb.data.\(setVar([^,()]*,[^,()]*\), *\([^ )]*\) *):\2.\1):g' \ -e 's:bb.data.\(setVarFlag([^,()]*,[^,()]*,[^,()]*\), *\([^) ]*\) *):\2.\1):g' \ -e 's:bb.data.\(getVar([^,()]*\), *\([^(), ]*\) *,\([^)]*\)):\2.\1,\3):g' \ -e 's:bb.data.\(getVarFlag([^,()]*,[^,()]*\), *\([^(), ]*\) *,\([^)]*\)):\2.\1,\3):g' \ -e 's:bb.data.\(getVarFlag([^,()]*,[^,()]*\), *\([^() ]*\) *):\2.\1):g' \ -e 's:bb.data.\(getVar([^,()]*\), *\([^) ]*\) *):\2.\1):g' \ -i `grep -ril bb.data *` (From OE-Core rev: b22831fd63164c4db9c0b72934d7d734a6585251) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2011-11-09 15:00:01 +00:00
pn = d.getVar("PN", True)
DistroData: Cleanup Version numbers and add DistroData Parser Signed-off-by: Saul Wold <Saul.Wold@intel.com>
2010-08-16 21:22:09 +00:00
bb.note("Package Name: %s" % pn)
distrodata: Modify Distro tracking spreadsheet Signed-off-by: Saul Wold <Saul.Wold@intel.com>
2010-10-15 20:51:33 +00:00
import oe.distro_check as dist_check
Convert to use direct access to the data store (instead of bb.data.*Var*()) This is the result of running the following over the metadata: sed \ -e 's:bb.data.\(setVar([^,()]*,[^,()]*\), *\([^ )]*\) *):\2.\1):g' \ -e 's:bb.data.\(setVarFlag([^,()]*,[^,()]*,[^,()]*\), *\([^) ]*\) *):\2.\1):g' \ -e 's:bb.data.\(getVar([^,()]*\), *\([^(), ]*\) *,\([^)]*\)):\2.\1,\3):g' \ -e 's:bb.data.\(getVarFlag([^,()]*,[^,()]*\), *\([^(), ]*\) *,\([^)]*\)):\2.\1,\3):g' \ -e 's:bb.data.\(getVarFlag([^,()]*,[^,()]*\), *\([^() ]*\) *):\2.\1):g' \ -e 's:bb.data.\(getVar([^,()]*\), *\([^) ]*\) *):\2.\1):g' \ -i `grep -ril bb.data *` (From OE-Core rev: b22831fd63164c4db9c0b72934d7d734a6585251) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2011-11-09 15:00:01 +00:00
tmpdir = d.getVar('TMPDIR', True)
distrodata: Modify Distro tracking spreadsheet Signed-off-by: Saul Wold <Saul.Wold@intel.com>
2010-10-15 20:51:33 +00:00
distro_check_dir = os.path.join(tmpdir, "distro_check")
Convert to use direct access to the data store (instead of bb.data.*Var*()) This is the result of running the following over the metadata: sed \ -e 's:bb.data.\(setVar([^,()]*,[^,()]*\), *\([^ )]*\) *):\2.\1):g' \ -e 's:bb.data.\(setVarFlag([^,()]*,[^,()]*,[^,()]*\), *\([^) ]*\) *):\2.\1):g' \ -e 's:bb.data.\(getVar([^,()]*\), *\([^(), ]*\) *,\([^)]*\)):\2.\1,\3):g' \ -e 's:bb.data.\(getVarFlag([^,()]*,[^,()]*\), *\([^(), ]*\) *,\([^)]*\)):\2.\1,\3):g' \ -e 's:bb.data.\(getVarFlag([^,()]*,[^,()]*\), *\([^() ]*\) *):\2.\1):g' \ -e 's:bb.data.\(getVar([^,()]*\), *\([^) ]*\) *):\2.\1):g' \ -i `grep -ril bb.data *` (From OE-Core rev: b22831fd63164c4db9c0b72934d7d734a6585251) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2011-11-09 15:00:01 +00:00
datetime = localdata.getVar('DATETIME', True)
distrodata: Modify Distro tracking spreadsheet Signed-off-by: Saul Wold <Saul.Wold@intel.com>
2010-10-15 20:51:33 +00:00
dist_check.update_distro_data(distro_check_dir, datetime)
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
if pn.find("-native") != -1:
pnstripped = pn.split("-native")
bb.note("Native Split: %s" % pnstripped)
localdata.setVar('OVERRIDES', "pn-" + pnstripped[0] + ":" + d.getVar('OVERRIDES', True))
bb.data.update_data(localdata)
if pn.find("-cross") != -1:
pnstripped = pn.split("-cross")
bb.note("cross Split: %s" % pnstripped)
localdata.setVar('OVERRIDES', "pn-" + pnstripped[0] + ":" + d.getVar('OVERRIDES', True))
bb.data.update_data(localdata)
if pn.find("-crosssdk") != -1:
pnstripped = pn.split("-crosssdk")
bb.note("cross Split: %s" % pnstripped)
localdata.setVar('OVERRIDES', "pn-" + pnstripped[0] + ":" + d.getVar('OVERRIDES', True))
bb.data.update_data(localdata)
distrodata: Update distrocheck functions Fix the distro check functions for the change of nativesdk being a suffix to a prefix. Also added crosssdk as another case for converting to PN for matching in the distro_tracking (From OE-Core rev: ae9dbd0e1e26ba2b35cbd08ec731aee62adedc23) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-10-03 16:33:16 +00:00
if pn.startswith("nativesdk-"):
pnstripped = pn.replace("nativesdk-", "")
bb.note("NativeSDK Split: %s" % pnstripped)
localdata.setVar('OVERRIDES', "pn-" + pnstripped + ":" + d.getVar('OVERRIDES', True))
bb.data.update_data(localdata)
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
if pn.find("-initial") != -1:
pnstripped = pn.split("-initial")
bb.note("initial Split: %s" % pnstripped)
localdata.setVar('OVERRIDES', "pn-" + pnstripped[0] + ":" + d.getVar('OVERRIDES', True))
bb.data.update_data(localdata)
"""generate package information from .bb file"""
pname = localdata.getVar('PN', True)
pcurver = localdata.getVar('PV', True)
pdesc = localdata.getVar('DESCRIPTION', True)
distrodata: Modify Distro tracking spreadsheet Signed-off-by: Saul Wold <Saul.Wold@intel.com>
2010-10-15 20:51:33 +00:00
if pdesc is not None:
pdesc = pdesc.replace(',','')
pdesc = pdesc.replace('\n','')
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
pgrp = localdata.getVar('SECTION', True)
plicense = localdata.getVar('LICENSE', True).replace(',','_')
DistroData: Cleanup Version numbers and add DistroData Parser Signed-off-by: Saul Wold <Saul.Wold@intel.com>
2010-08-16 21:22:09 +00:00
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
rstatus = localdata.getVar('RECIPE_COLOR', True)
distrodata: Modify Distro tracking spreadsheet Signed-off-by: Saul Wold <Saul.Wold@intel.com>
2010-10-15 20:51:33 +00:00
if rstatus is not None:
rstatus = rstatus.replace(',','')
distrodata.bbclass: Remove whitespaces (From OE-Core rev: 2275dd9507fa7b8c3e62ffcf8b9b16120f16fe8f) Signed-off-by: Emilia Ciobanu <emilia.maria.silvia.ciobanu@intel.com> Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2013-07-26 15:58:18 +00:00
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
pupver = localdata.getVar('RECIPE_UPSTREAM_VERSION', True)
if pcurver == pupver:
vermatch="1"
else:
vermatch="0"
noupdate_reason = localdata.getVar('RECIPE_NO_UPDATE_REASON', True)
if noupdate_reason is None:
noupdate="0"
else:
noupdate="1"
distrodata: Modify Distro tracking spreadsheet Signed-off-by: Saul Wold <Saul.Wold@intel.com>
2010-10-15 20:51:33 +00:00
noupdate_reason = noupdate_reason.replace(',','')
DistroData: Cleanup Version numbers and add DistroData Parser Signed-off-by: Saul Wold <Saul.Wold@intel.com>
2010-08-16 21:22:09 +00:00
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
maintainer = localdata.getVar('RECIPE_MAINTAINER', True)
rlrd = localdata.getVar('RECIPE_UPSTREAM_DATE', True)
distrodata: Modify Distro tracking spreadsheet Signed-off-by: Saul Wold <Saul.Wold@intel.com>
2010-10-15 20:51:33 +00:00
result = dist_check.compare_in_distro_packages_list(distro_check_dir, localdata)
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
bb.note("DISTRO: %s,%s,%s,%s,%s,%s,%s,%s,%s\n" % \
(pname, pdesc, maintainer, plicense, vermatch, pcurver, pupver, noupdate_reason, rstatus))
distrodata: Modify Distro tracking spreadsheet Signed-off-by: Saul Wold <Saul.Wold@intel.com>
2010-10-15 20:51:33 +00:00
line = pn
for i in result:
line = line + "," + i
bb.note("%s\n" % line)
DistroData: Cleanup Version numbers and add DistroData Parser Signed-off-by: Saul Wold <Saul.Wold@intel.com>
2010-08-16 21:22:09 +00:00
}
addtask distrodata
do_distrodata[nostamp] = "1"
python do_distrodata() {
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
logpath = d.getVar('LOG_DIR', True)
bb.utils.mkdirhier(logpath)
logfile = os.path.join(logpath, "distrodata.csv")
DistroData: Cleanup Version numbers and add DistroData Parser Signed-off-by: Saul Wold <Saul.Wold@intel.com>
2010-08-16 21:22:09 +00:00
distrodata: Modify Distro tracking spreadsheet Signed-off-by: Saul Wold <Saul.Wold@intel.com>
2010-10-15 20:51:33 +00:00
import oe.distro_check as dist_check
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
localdata = bb.data.createCopy(d)
Convert to use direct access to the data store (instead of bb.data.*Var*()) This is the result of running the following over the metadata: sed \ -e 's:bb.data.\(setVar([^,()]*,[^,()]*\), *\([^ )]*\) *):\2.\1):g' \ -e 's:bb.data.\(setVarFlag([^,()]*,[^,()]*,[^,()]*\), *\([^) ]*\) *):\2.\1):g' \ -e 's:bb.data.\(getVar([^,()]*\), *\([^(), ]*\) *,\([^)]*\)):\2.\1,\3):g' \ -e 's:bb.data.\(getVarFlag([^,()]*,[^,()]*\), *\([^(), ]*\) *,\([^)]*\)):\2.\1,\3):g' \ -e 's:bb.data.\(getVarFlag([^,()]*,[^,()]*\), *\([^() ]*\) *):\2.\1):g' \ -e 's:bb.data.\(getVar([^,()]*\), *\([^) ]*\) *):\2.\1):g' \ -i `grep -ril bb.data *` (From OE-Core rev: b22831fd63164c4db9c0b72934d7d734a6585251) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2011-11-09 15:00:01 +00:00
tmpdir = d.getVar('TMPDIR', True)
distrodata: Modify Distro tracking spreadsheet Signed-off-by: Saul Wold <Saul.Wold@intel.com>
2010-10-15 20:51:33 +00:00
distro_check_dir = os.path.join(tmpdir, "distro_check")
Convert to use direct access to the data store (instead of bb.data.*Var*()) This is the result of running the following over the metadata: sed \ -e 's:bb.data.\(setVar([^,()]*,[^,()]*\), *\([^ )]*\) *):\2.\1):g' \ -e 's:bb.data.\(setVarFlag([^,()]*,[^,()]*,[^,()]*\), *\([^) ]*\) *):\2.\1):g' \ -e 's:bb.data.\(getVar([^,()]*\), *\([^(), ]*\) *,\([^)]*\)):\2.\1,\3):g' \ -e 's:bb.data.\(getVarFlag([^,()]*,[^,()]*\), *\([^(), ]*\) *,\([^)]*\)):\2.\1,\3):g' \ -e 's:bb.data.\(getVarFlag([^,()]*,[^,()]*\), *\([^() ]*\) *):\2.\1):g' \ -e 's:bb.data.\(getVar([^,()]*\), *\([^) ]*\) *):\2.\1):g' \ -i `grep -ril bb.data *` (From OE-Core rev: b22831fd63164c4db9c0b72934d7d734a6585251) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2011-11-09 15:00:01 +00:00
datetime = localdata.getVar('DATETIME', True)
distrodata: Modify Distro tracking spreadsheet Signed-off-by: Saul Wold <Saul.Wold@intel.com>
2010-10-15 20:51:33 +00:00
dist_check.update_distro_data(distro_check_dir, datetime)
Convert to use direct access to the data store (instead of bb.data.*Var*()) This is the result of running the following over the metadata: sed \ -e 's:bb.data.\(setVar([^,()]*,[^,()]*\), *\([^ )]*\) *):\2.\1):g' \ -e 's:bb.data.\(setVarFlag([^,()]*,[^,()]*,[^,()]*\), *\([^) ]*\) *):\2.\1):g' \ -e 's:bb.data.\(getVar([^,()]*\), *\([^(), ]*\) *,\([^)]*\)):\2.\1,\3):g' \ -e 's:bb.data.\(getVarFlag([^,()]*,[^,()]*\), *\([^(), ]*\) *,\([^)]*\)):\2.\1,\3):g' \ -e 's:bb.data.\(getVarFlag([^,()]*,[^,()]*\), *\([^() ]*\) *):\2.\1):g' \ -e 's:bb.data.\(getVar([^,()]*\), *\([^) ]*\) *):\2.\1):g' \ -i `grep -ril bb.data *` (From OE-Core rev: b22831fd63164c4db9c0b72934d7d734a6585251) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2011-11-09 15:00:01 +00:00
pn = d.getVar("PN", True)
DistroData: Cleanup Version numbers and add DistroData Parser Signed-off-by: Saul Wold <Saul.Wold@intel.com>
2010-08-16 21:22:09 +00:00
bb.note("Package Name: %s" % pn)
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
if pn.find("-native") != -1:
pnstripped = pn.split("-native")
bb.note("Native Split: %s" % pnstripped)
localdata.setVar('OVERRIDES', "pn-" + pnstripped[0] + ":" + d.getVar('OVERRIDES', True))
bb.data.update_data(localdata)
distrodata: Update distrocheck functions Fix the distro check functions for the change of nativesdk being a suffix to a prefix. Also added crosssdk as another case for converting to PN for matching in the distro_tracking (From OE-Core rev: ae9dbd0e1e26ba2b35cbd08ec731aee62adedc23) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-10-03 16:33:16 +00:00
if pn.startswith("nativesdk-"):
pnstripped = pn.replace("nativesdk-", "")
bb.note("NativeSDK Split: %s" % pnstripped)
localdata.setVar('OVERRIDES', "pn-" + pnstripped + ":" + d.getVar('OVERRIDES', True))
bb.data.update_data(localdata)
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
if pn.find("-cross") != -1:
pnstripped = pn.split("-cross")
bb.note("cross Split: %s" % pnstripped)
localdata.setVar('OVERRIDES', "pn-" + pnstripped[0] + ":" + d.getVar('OVERRIDES', True))
bb.data.update_data(localdata)
distrodata: Update distrocheck functions Fix the distro check functions for the change of nativesdk being a suffix to a prefix. Also added crosssdk as another case for converting to PN for matching in the distro_tracking (From OE-Core rev: ae9dbd0e1e26ba2b35cbd08ec731aee62adedc23) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-10-03 16:33:16 +00:00
if pn.find("-crosssdk") != -1:
pnstripped = pn.split("-crosssdk")
bb.note("cross Split: %s" % pnstripped)
localdata.setVar('OVERRIDES', "pn-" + pnstripped[0] + ":" + d.getVar('OVERRIDES', True))
bb.data.update_data(localdata)
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
if pn.find("-initial") != -1:
pnstripped = pn.split("-initial")
bb.note("initial Split: %s" % pnstripped)
localdata.setVar('OVERRIDES', "pn-" + pnstripped[0] + ":" + d.getVar('OVERRIDES', True))
bb.data.update_data(localdata)
"""generate package information from .bb file"""
pname = localdata.getVar('PN', True)
pcurver = localdata.getVar('PV', True)
pdesc = localdata.getVar('DESCRIPTION', True)
distrodata: Modify Distro tracking spreadsheet Signed-off-by: Saul Wold <Saul.Wold@intel.com>
2010-10-15 20:51:33 +00:00
if pdesc is not None:
pdesc = pdesc.replace(',','')
pdesc = pdesc.replace('\n','')
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
pgrp = localdata.getVar('SECTION', True)
plicense = localdata.getVar('LICENSE', True).replace(',','_')
DistroData: Cleanup Version numbers and add DistroData Parser Signed-off-by: Saul Wold <Saul.Wold@intel.com>
2010-08-16 21:22:09 +00:00
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
rstatus = localdata.getVar('RECIPE_COLOR', True)
distrodata: Modify Distro tracking spreadsheet Signed-off-by: Saul Wold <Saul.Wold@intel.com>
2010-10-15 20:51:33 +00:00
if rstatus is not None:
rstatus = rstatus.replace(',','')
distrodata.bbclass: Remove whitespaces (From OE-Core rev: 2275dd9507fa7b8c3e62ffcf8b9b16120f16fe8f) Signed-off-by: Emilia Ciobanu <emilia.maria.silvia.ciobanu@intel.com> Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2013-07-26 15:58:18 +00:00
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
pupver = localdata.getVar('RECIPE_UPSTREAM_VERSION', True)
if pcurver == pupver:
vermatch="1"
else:
vermatch="0"
noupdate_reason = localdata.getVar('RECIPE_NO_UPDATE_REASON', True)
if noupdate_reason is None:
noupdate="0"
else:
noupdate="1"
distrodata: Modify Distro tracking spreadsheet Signed-off-by: Saul Wold <Saul.Wold@intel.com>
2010-10-15 20:51:33 +00:00
noupdate_reason = noupdate_reason.replace(',','')
DistroData: Cleanup Version numbers and add DistroData Parser Signed-off-by: Saul Wold <Saul.Wold@intel.com>
2010-08-16 21:22:09 +00:00
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
maintainer = localdata.getVar('RECIPE_MAINTAINER', True)
rlrd = localdata.getVar('RECIPE_UPSTREAM_DATE', True)
distrodata: Modify Distro tracking spreadsheet Signed-off-by: Saul Wold <Saul.Wold@intel.com>
2010-10-15 20:51:33 +00:00
# do the comparison
result = dist_check.compare_in_distro_packages_list(distro_check_dir, localdata)
DistroData: Cleanup Version numbers and add DistroData Parser Signed-off-by: Saul Wold <Saul.Wold@intel.com>
2010-08-16 21:22:09 +00:00
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
lf = bb.utils.lockfile("%s.lock" % logfile)
f = open(logfile, "a")
f.write("%s,%s,%s,%s,%s,%s,%s,%s,%s" % \
(pname, pdesc, maintainer, plicense, vermatch, pcurver, pupver, noupdate_reason, rstatus))
distrodata: Modify Distro tracking spreadsheet Signed-off-by: Saul Wold <Saul.Wold@intel.com>
2010-10-15 20:51:33 +00:00
line = ""
for i in result:
line = line + "," + i
f.write(line + "\n")
f.close()
bb.utils.unlockfile(lf)
DistroData: Cleanup Version numbers and add DistroData Parser Signed-off-by: Saul Wold <Saul.Wold@intel.com>
2010-08-16 21:22:09 +00:00
}
addtask distrodataall after do_distrodata
meta/classes: Update recrdeptask fields for recursive dependency handling changes in bitbake This also deletes the buildall task since I seen usecases for it. (From OE-Core rev: 8229fb5d7205f5e5b198ab2860fbcc02054476eb) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-07-02 12:27:46 +00:00
do_distrodataall[recrdeptask] = "do_distrodataall do_distrodata"
utility-tasks/distrodata: Add recideptask flag for fetchall/checkuriall See the bitbake commit adding the recideptask flag for details of the problem but in summary, we weren't seeing the [depends] of tasks like do_rootfs being taking into account for fetchall. This was leading to not all sources being fetched and this is the OE-Core part of the fix for this problem. BB_DEFAULT_TASK is the default task used since this is the one that most commands would end up targeting and is how users expect the command to behave. [YOCTO #4597] (From OE-Core rev: abf468963a087244887384122fd5202909e7f118) (From OE-Core rev: e385cc4ac06ac1e8d257563a700d19895105eade) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2013-06-19 13:05:17 +00:00
do_distrodataall[recideptask] = "do_${BB_DEFAULT_TASK}"
DistroData: Cleanup Version numbers and add DistroData Parser Signed-off-by: Saul Wold <Saul.Wold@intel.com>
2010-08-16 21:22:09 +00:00
do_distrodataall[nostamp] = "1"
do_distrodataall() {
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
:
DistroData: Cleanup Version numbers and add DistroData Parser Signed-off-by: Saul Wold <Saul.Wold@intel.com>
2010-08-16 21:22:09 +00:00
}
distrodata: add eventhandler for checkpkg task Change group column to Owner Column for checkpkg output Signed-off-by: Saul Wold <sgw@linux.intel.com>
2010-12-15 02:30:47 +00:00
addhandler checkpkg_eventhandler
distrodata.bbclass: fix syntax errors Thes were added by the recent event handler changes. (From OE-Core rev: 166313ca2edd05f7d3472ba23ba6f44ae12a7d12) Signed-off-by: Laurentiu Palcu <laurentiu.palcu@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2013-06-15 12:17:36 +00:00
checkpkg_eventhandler[eventmask] = "bb.event.BuildStarted bb.event.BuildCompleted"
distrodata: add eventhandler for checkpkg task Change group column to Owner Column for checkpkg output Signed-off-by: Saul Wold <sgw@linux.intel.com>
2010-12-15 02:30:47 +00:00
python checkpkg_eventhandler() {
distrodata: Updated checkpkg task bitbake -c checkpkg fetches the latest version for all packages, including the ones from sourceforge and those that have ununsual package naming. Also removed all pn-native/nativesdk-pn entries from the resulting checkpkg.csv file if the system already reported the latest version for pn. (From OE-Core rev: dc33d69df55ad8d63024d34e35a0b987e01b0077) Signed-off-by: Emilia Ciobanu <emilia.maria.silvia.ciobanu@intel.com> Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2013-01-14 09:04:33 +00:00
def parse_csv_file(filename):
package_dict = {}
fd = open(filename, "r")
lines = fd.read().rsplit("\n")
fd.close()
first_line = ''
index = 0
for line in lines:
#Skip the first line
if index == 0:
first_line = line
index += 1
continue
elif line == '':
continue
index += 1
package_name = line.rsplit("\t")[0]
if '-native' in package_name or 'nativesdk-' in package_name:
original_name = package_name.rsplit('-native')[0]
if original_name == '':
original_name = package_name.rsplit('nativesdk-')[0]
if original_name in package_dict:
continue
else:
package_dict[package_name] = line
else:
new_name = package_name + "-native"
if not(new_name in package_dict):
new_name = 'nativesdk-' + package_name
if new_name in package_dict:
del package_dict[new_name]
package_dict[package_name] = line
fd = open(filename, "w")
fd.write("%s\n"%first_line)
for el in package_dict:
fd.write(package_dict[el] + "\n")
fd.close()
del package_dict
distrodata: add eventhandler for checkpkg task Change group column to Owner Column for checkpkg output Signed-off-by: Saul Wold <sgw@linux.intel.com>
2010-12-15 02:30:47 +00:00
if bb.event.getName(e) == "BuildStarted":
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
import oe.distro_check as dc
logfile = dc.create_log_file(e.data, "checkpkg.csv")
Add a new task checklicense and fix some bugs in distro_check.py distro_check.py: Create a new function called create_log_file to reduce a lot of repeat code in distrodata.bbclass. We needn't to create log file in function save_distro_check_result, because the log file has been generated in check_eventhandler. Another bug is that we maybe access the /tmp/Meego-1.0 before we create this file. Add a judge statement to decide whether we need to create this file firstly. distrodata.bbclass: Add a new task checklicense to collect missing text license information. This can help package-report system to know how many recipes are missing license text. (From OE-Core rev: b41148cda9f0cc292b662a8473f26bc1ee0148f3) Signed-off-by: Mei Lei <lei.mei@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2011-05-16 11:06:21 +00:00
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
lf = bb.utils.lockfile("%s.lock" % logfile)
f = open(logfile, "a")
distrodata.bbclass: added some more git processing * Truncated all git MD5 sums to 7 digits * Added regex checking for git packages as well (From OE-Core rev: bc830ab3f6e9704c830e934c6f39c85ef11f867d) Signed-off-by: Emilia Ciobanu <emilia.maria.silvia.ciobanu@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2013-03-22 08:30:58 +00:00
f.write("Package\tVersion\tUpver\tLicense\tSection\tHome\tRelease\tDepends\tBugTracker\tPE\tDescription\tStatus\tTracking\tURI\tMAINTAINER\tNoUpReason\n")
distrodata: add eventhandler for checkpkg task Change group column to Owner Column for checkpkg output Signed-off-by: Saul Wold <sgw@linux.intel.com>
2010-12-15 02:30:47 +00:00
f.close()
bb.utils.unlockfile(lf)
distrodata: Updated checkpkg task bitbake -c checkpkg fetches the latest version for all packages, including the ones from sourceforge and those that have ununsual package naming. Also removed all pn-native/nativesdk-pn entries from the resulting checkpkg.csv file if the system already reported the latest version for pn. (From OE-Core rev: dc33d69df55ad8d63024d34e35a0b987e01b0077) Signed-off-by: Emilia Ciobanu <emilia.maria.silvia.ciobanu@intel.com> Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2013-01-14 09:04:33 +00:00
elif bb.event.getName(e) == "BuildCompleted":
import os
filename = "tmp/log/checkpkg.csv"
if os.path.isfile(filename):
lf = bb.utils.lockfile("%s.lock"%filename)
parse_csv_file(filename)
bb.utils.unlockfile(lf)
classes: Drop Handled/NotHandled eventhandler keywords, they don't do anything Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-12-30 18:40:32 +00:00
return
distrodata: add eventhandler for checkpkg task Change group column to Owner Column for checkpkg output Signed-off-by: Saul Wold <sgw@linux.intel.com>
2010-12-15 02:30:47 +00:00
}
utility-tasks.bbclass: Move distro related tasks to distrodata.bbclass Most of the d.keys() used in file parsing are variables in distro_tracking_fields.inc, which are not used in normal build. Therefore remove the inclusion of distro_tracking_fields.inc from poky.conf. Besides, move distro related tasks to distrodata.bbclass, which includes that tracking field file. By this change, the file parsing time could save about 25%. Signed-off-by: Dongxiao Xu <dongxiao.xu@intel.com>
2010-11-22 06:02:37 +00:00
addtask checkpkg
do_checkpkg[nostamp] = "1"
python do_checkpkg() {
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
localdata = bb.data.createCopy(d)
import re
import tempfile
import subprocess
distrodata: checkpkg make usage of oe.recipeutils.get_recipe_upstream_version Now get_recipe_upstream_version function exists in oe.recipeutils module to avoid duplicate code make usage of it. (From OE-Core rev: eb296224f24d4bcc833d81a86a71345dfd0e9db4) Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2015-06-02 16:51:19 +00:00
import oe.recipeutils
from bb.utils import vercmp_string
from bb.fetch2 import FetchError, NoMethodError, decodeurl
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
"""first check whether a uri is provided"""
src_uri = d.getVar('SRC_URI', True)
if not src_uri:
return
distrodata: checkpkg make usage of oe.recipeutils.get_recipe_upstream_version Now get_recipe_upstream_version function exists in oe.recipeutils module to avoid duplicate code make usage of it. (From OE-Core rev: eb296224f24d4bcc833d81a86a71345dfd0e9db4) Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2015-06-02 16:51:19 +00:00
uri_type, _, _, _, _, _ = decodeurl(src_uri)
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
"""initialize log files."""
logpath = d.getVar('LOG_DIR', True)
bb.utils.mkdirhier(logpath)
logfile = os.path.join(logpath, "checkpkg.csv")
"""generate package information from .bb file"""
pname = d.getVar('PN', True)
if pname.find("-native") != -1:
distrodata: Updated checkpkg task bitbake -c checkpkg fetches the latest version for all packages, including the ones from sourceforge and those that have ununsual package naming. Also removed all pn-native/nativesdk-pn entries from the resulting checkpkg.csv file if the system already reported the latest version for pn. (From OE-Core rev: dc33d69df55ad8d63024d34e35a0b987e01b0077) Signed-off-by: Emilia Ciobanu <emilia.maria.silvia.ciobanu@intel.com> Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2013-01-14 09:04:33 +00:00
if d.getVar('BBCLASSEXTEND', True):
return
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
pnstripped = pname.split("-native")
bb.note("Native Split: %s" % pnstripped)
localdata.setVar('OVERRIDES', "pn-" + pnstripped[0] + ":" + d.getVar('OVERRIDES', True))
bb.data.update_data(localdata)
distrodata: Updated checkpkg task bitbake -c checkpkg fetches the latest version for all packages, including the ones from sourceforge and those that have ununsual package naming. Also removed all pn-native/nativesdk-pn entries from the resulting checkpkg.csv file if the system already reported the latest version for pn. (From OE-Core rev: dc33d69df55ad8d63024d34e35a0b987e01b0077) Signed-off-by: Emilia Ciobanu <emilia.maria.silvia.ciobanu@intel.com> Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2013-01-14 09:04:33 +00:00
if pname.startswith("nativesdk-"):
if d.getVar('BBCLASSEXTEND', True):
return
pnstripped = pname.replace("nativesdk-", "")
bb.note("NativeSDK Split: %s" % pnstripped)
localdata.setVar('OVERRIDES', "pn-" + pnstripped + ":" + d.getVar('OVERRIDES', True))
bb.data.update_data(localdata)
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
if pname.find("-cross") != -1:
pnstripped = pname.split("-cross")
bb.note("cross Split: %s" % pnstripped)
localdata.setVar('OVERRIDES', "pn-" + pnstripped[0] + ":" + d.getVar('OVERRIDES', True))
bb.data.update_data(localdata)
if pname.find("-initial") != -1:
pnstripped = pname.split("-initial")
bb.note("initial Split: %s" % pnstripped)
localdata.setVar('OVERRIDES', "pn-" + pnstripped[0] + ":" + d.getVar('OVERRIDES', True))
bb.data.update_data(localdata)
pdesc = localdata.getVar('DESCRIPTION', True)
pgrp = localdata.getVar('SECTION', True)
distrodata: checkpkg make usage of oe.recipeutils.get_recipe_upstream_version Now get_recipe_upstream_version function exists in oe.recipeutils module to avoid duplicate code make usage of it. (From OE-Core rev: eb296224f24d4bcc833d81a86a71345dfd0e9db4) Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2015-06-02 16:51:19 +00:00
pversion = localdata.getVar('PV', True)
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
plicense = localdata.getVar('LICENSE', True)
psection = localdata.getVar('SECTION', True)
phome = localdata.getVar('HOMEPAGE', True)
prelease = localdata.getVar('PR', True)
pdepends = localdata.getVar('DEPENDS', True)
pbugtracker = localdata.getVar('BUGTRACKER', True)
ppe = localdata.getVar('PE', True)
psrcuri = localdata.getVar('SRC_URI', True)
maintainer = localdata.getVar('RECIPE_MAINTAINER', True)
distrodata_class: checkpkg make usage of latest_versionstring methods in bitbake fetcher Because methods for get latest version of upstream package are now available into bitbake removes duplicated code and make use of it. Compatibility testing was made running distrodata class and the result files can be found at: https://bugzilla.yoctoproject.org/show_bug.cgi?id=1813 [YOCTO #1813] (From OE-Core rev: 68ddb28a68ceb59cd1ed322c16143827ce1ac712) Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-11-28 01:09:43 +00:00
""" Get upstream version version """
distrodata: checkpkg make usage of oe.recipeutils.get_recipe_upstream_version Now get_recipe_upstream_version function exists in oe.recipeutils module to avoid duplicate code make usage of it. (From OE-Core rev: eb296224f24d4bcc833d81a86a71345dfd0e9db4) Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2015-06-02 16:51:19 +00:00
pupver = ""
pstatus = ""
try:
uv = oe.recipeutils.get_recipe_upstream_version(localdata)
pupver = uv['version']
except Exception as e:
if e is FetchError:
distrodata_class: checkpkg make usage of latest_versionstring methods in bitbake fetcher Because methods for get latest version of upstream package are now available into bitbake removes duplicated code and make use of it. Compatibility testing was made running distrodata class and the result files can be found at: https://bugzilla.yoctoproject.org/show_bug.cgi?id=1813 [YOCTO #1813] (From OE-Core rev: 68ddb28a68ceb59cd1ed322c16143827ce1ac712) Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-11-28 01:09:43 +00:00
pstatus = "ErrAccess"
distrodata: checkpkg make usage of oe.recipeutils.get_recipe_upstream_version Now get_recipe_upstream_version function exists in oe.recipeutils module to avoid duplicate code make usage of it. (From OE-Core rev: eb296224f24d4bcc833d81a86a71345dfd0e9db4) Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2015-06-02 16:51:19 +00:00
elif e is NoMethodError:
pstatus = "ErrUnsupportedProto"
else:
pstatus = "ErrUnknown"
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
distrodata: checkpkg make usage of oe.recipeutils.get_recipe_upstream_version Now get_recipe_upstream_version function exists in oe.recipeutils module to avoid duplicate code make usage of it. (From OE-Core rev: eb296224f24d4bcc833d81a86a71345dfd0e9db4) Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2015-06-02 16:51:19 +00:00
"""Set upstream version status"""
distrodata_class: checkpkg make usage of latest_versionstring methods in bitbake fetcher Because methods for get latest version of upstream package are now available into bitbake removes duplicated code and make use of it. Compatibility testing was made running distrodata class and the result files can be found at: https://bugzilla.yoctoproject.org/show_bug.cgi?id=1813 [YOCTO #1813] (From OE-Core rev: 68ddb28a68ceb59cd1ed322c16143827ce1ac712) Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-11-28 01:09:43 +00:00
if not pupver:
pupver = "N/A"
else:
distrodata: checkpkg make usage of oe.recipeutils.get_recipe_upstream_version Now get_recipe_upstream_version function exists in oe.recipeutils module to avoid duplicate code make usage of it. (From OE-Core rev: eb296224f24d4bcc833d81a86a71345dfd0e9db4) Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2015-06-02 16:51:19 +00:00
pv, _, _ = oe.recipeutils.get_recipe_pv_without_srcpv(pversion, uri_type)
upv, _, _ = oe.recipeutils.get_recipe_pv_without_srcpv(pupver, uri_type)
cmp = vercmp_string(pv, upv)
if cmp == -1:
pstatus = "UPDATE"
elif cmp == 0:
pstatus = "MATCH"
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
"""Read from manual distro tracking fields as alternative"""
pmver = d.getVar("RECIPE_UPSTREAM_VERSION", True)
if not pmver:
distrodata_class: checkpkg make usage of latest_versionstring methods in bitbake fetcher Because methods for get latest version of upstream package are now available into bitbake removes duplicated code and make use of it. Compatibility testing was made running distrodata class and the result files can be found at: https://bugzilla.yoctoproject.org/show_bug.cgi?id=1813 [YOCTO #1813] (From OE-Core rev: 68ddb28a68ceb59cd1ed322c16143827ce1ac712) Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-11-28 01:09:43 +00:00
pmver = "N/A"
pmstatus = "ErrNoRecipeData"
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
else:
distrodata: checkpkg make usage of oe.recipeutils.get_recipe_upstream_version Now get_recipe_upstream_version function exists in oe.recipeutils module to avoid duplicate code make usage of it. (From OE-Core rev: eb296224f24d4bcc833d81a86a71345dfd0e9db4) Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2015-06-02 16:51:19 +00:00
mpv, _, _ = oe.recipeutils.get_recipe_pv_without_srcpv(pmver, uri_type)
upv, _, _ = oe.recipeutils.get_recipe_pv_without_srcpv(pupver, uri_type)
cmp = vercmp_string(mpv, upv)
if cmp == -1:
pmstatus = "UPDATE"
elif cmp == 0:
pmstatus = "MATCH"
else:
pmstatus = ""
distrodata.bbclass: Remove whitespaces (From OE-Core rev: 2275dd9507fa7b8c3e62ffcf8b9b16120f16fe8f) Signed-off-by: Emilia Ciobanu <emilia.maria.silvia.ciobanu@intel.com> Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2013-07-26 15:58:18 +00:00
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
pdepends = "".join(pdepends.split("\t"))
pdesc = "".join(pdesc.split("\t"))
distrodata.bbclass: added some more git processing * Truncated all git MD5 sums to 7 digits * Added regex checking for git packages as well (From OE-Core rev: bc830ab3f6e9704c830e934c6f39c85ef11f867d) Signed-off-by: Emilia Ciobanu <emilia.maria.silvia.ciobanu@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2013-03-22 08:30:58 +00:00
no_upgr_reason = d.getVar('RECIPE_NO_UPDATE_REASON', True)
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
lf = bb.utils.lockfile("%s.lock" % logfile)
f = open(logfile, "a")
distrodata.bbclass: added some more git processing * Truncated all git MD5 sums to 7 digits * Added regex checking for git packages as well (From OE-Core rev: bc830ab3f6e9704c830e934c6f39c85ef11f867d) Signed-off-by: Emilia Ciobanu <emilia.maria.silvia.ciobanu@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2013-03-22 08:30:58 +00:00
f.write("%s\t%s\t%s\t%s\t%s\t%s\t%s\t%s\t%s\t%s\t%s\t%s\t%s\t%s\t%s\t%s\n" % \
(pname,pversion,pupver,plicense,psection, phome,prelease, pdepends,pbugtracker,ppe,pdesc,pstatus,pmver,psrcuri,maintainer, no_upgr_reason))
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
f.close()
bb.utils.unlockfile(lf)
utility-tasks.bbclass: Move distro related tasks to distrodata.bbclass Most of the d.keys() used in file parsing are variables in distro_tracking_fields.inc, which are not used in normal build. Therefore remove the inclusion of distro_tracking_fields.inc from poky.conf. Besides, move distro related tasks to distrodata.bbclass, which includes that tracking field file. By this change, the file parsing time could save about 25%. Signed-off-by: Dongxiao Xu <dongxiao.xu@intel.com>
2010-11-22 06:02:37 +00:00
}
addtask checkpkgall after do_checkpkg
meta/classes: Update recrdeptask fields for recursive dependency handling changes in bitbake This also deletes the buildall task since I seen usecases for it. (From OE-Core rev: 8229fb5d7205f5e5b198ab2860fbcc02054476eb) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-07-02 12:27:46 +00:00
do_checkpkgall[recrdeptask] = "do_checkpkgall do_checkpkg"
utility-tasks/distrodata: Add recideptask flag for fetchall/checkuriall See the bitbake commit adding the recideptask flag for details of the problem but in summary, we weren't seeing the [depends] of tasks like do_rootfs being taking into account for fetchall. This was leading to not all sources being fetched and this is the OE-Core part of the fix for this problem. BB_DEFAULT_TASK is the default task used since this is the one that most commands would end up targeting and is how users expect the command to behave. [YOCTO #4597] (From OE-Core rev: abf468963a087244887384122fd5202909e7f118) (From OE-Core rev: e385cc4ac06ac1e8d257563a700d19895105eade) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2013-06-19 13:05:17 +00:00
do_checkpkgall[recideptask] = "do_${BB_DEFAULT_TASK}"
utility-tasks.bbclass: Move distro related tasks to distrodata.bbclass Most of the d.keys() used in file parsing are variables in distro_tracking_fields.inc, which are not used in normal build. Therefore remove the inclusion of distro_tracking_fields.inc from poky.conf. Besides, move distro related tasks to distrodata.bbclass, which includes that tracking field file. By this change, the file parsing time could save about 25%. Signed-off-by: Dongxiao Xu <dongxiao.xu@intel.com>
2010-11-22 06:02:37 +00:00
do_checkpkgall[nostamp] = "1"
do_checkpkgall() {
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
:
utility-tasks.bbclass: Move distro related tasks to distrodata.bbclass Most of the d.keys() used in file parsing are variables in distro_tracking_fields.inc, which are not used in normal build. Therefore remove the inclusion of distro_tracking_fields.inc from poky.conf. Besides, move distro related tasks to distrodata.bbclass, which includes that tracking field file. By this change, the file parsing time could save about 25%. Signed-off-by: Dongxiao Xu <dongxiao.xu@intel.com>
2010-11-22 06:02:37 +00:00
}
Add a new task checklicense and fix some bugs in distro_check.py distro_check.py: Create a new function called create_log_file to reduce a lot of repeat code in distrodata.bbclass. We needn't to create log file in function save_distro_check_result, because the log file has been generated in check_eventhandler. Another bug is that we maybe access the /tmp/Meego-1.0 before we create this file. Add a judge statement to decide whether we need to create this file firstly. distrodata.bbclass: Add a new task checklicense to collect missing text license information. This can help package-report system to know how many recipes are missing license text. (From OE-Core rev: b41148cda9f0cc292b662a8473f26bc1ee0148f3) Signed-off-by: Mei Lei <lei.mei@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2011-05-16 11:06:21 +00:00
addhandler distro_check_eventhandler
distrodata.bbclass: fix syntax errors Thes were added by the recent event handler changes. (From OE-Core rev: 166313ca2edd05f7d3472ba23ba6f44ae12a7d12) Signed-off-by: Laurentiu Palcu <laurentiu.palcu@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2013-06-15 12:17:36 +00:00
distro_check_eventhandler[eventmask] = "bb.event.BuildStarted"
Add a new task checklicense and fix some bugs in distro_check.py distro_check.py: Create a new function called create_log_file to reduce a lot of repeat code in distrodata.bbclass. We needn't to create log file in function save_distro_check_result, because the log file has been generated in check_eventhandler. Another bug is that we maybe access the /tmp/Meego-1.0 before we create this file. Add a judge statement to decide whether we need to create this file firstly. distrodata.bbclass: Add a new task checklicense to collect missing text license information. This can help package-report system to know how many recipes are missing license text. (From OE-Core rev: b41148cda9f0cc292b662a8473f26bc1ee0148f3) Signed-off-by: Mei Lei <lei.mei@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2011-05-16 11:06:21 +00:00
python distro_check_eventhandler() {
classes/conf: Add eventmasks for event handlers Now that bitbake supports masking events for event handlers, lets use this so event handlers are only called for events they care about. This lets us simplify the code indentation a bit at least as well as mildly improving the event handling performance. (From OE-Core rev: bff73743280f9eafebe4591f7368ead91a4eb74d) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2013-06-12 16:31:57 +00:00
"""initialize log files."""
import oe.distro_check as dc
result_file = dc.create_log_file(e.data, "distrocheck.csv")
classes: Drop Handled/NotHandled eventhandler keywords, they don't do anything Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-12-30 18:40:32 +00:00
return
utility-tasks.bbclass: Move distro related tasks to distrodata.bbclass Most of the d.keys() used in file parsing are variables in distro_tracking_fields.inc, which are not used in normal build. Therefore remove the inclusion of distro_tracking_fields.inc from poky.conf. Besides, move distro related tasks to distrodata.bbclass, which includes that tracking field file. By this change, the file parsing time could save about 25%. Signed-off-by: Dongxiao Xu <dongxiao.xu@intel.com>
2010-11-22 06:02:37 +00:00
}
addtask distro_check
do_distro_check[nostamp] = "1"
python do_distro_check() {
"""checks if the package is present in other public Linux distros"""
import oe.distro_check as dc
Add a new task checklicense and fix some bugs in distro_check.py distro_check.py: Create a new function called create_log_file to reduce a lot of repeat code in distrodata.bbclass. We needn't to create log file in function save_distro_check_result, because the log file has been generated in check_eventhandler. Another bug is that we maybe access the /tmp/Meego-1.0 before we create this file. Add a judge statement to decide whether we need to create this file firstly. distrodata.bbclass: Add a new task checklicense to collect missing text license information. This can help package-report system to know how many recipes are missing license text. (From OE-Core rev: b41148cda9f0cc292b662a8473f26bc1ee0148f3) Signed-off-by: Mei Lei <lei.mei@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2011-05-16 11:06:21 +00:00
import shutil
distrodata: fix distro_check code This fixes a problem with package names from inherits showing up (From OE-Core rev: edb2a11994ac21e790155ea519bded4b37ef9307) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2011-09-20 20:40:48 +00:00
if bb.data.inherits_class('native', d) or bb.data.inherits_class('cross', d) or bb.data.inherits_class('sdk', d) or bb.data.inherits_class('crosssdk', d) or bb.data.inherits_class('nativesdk',d):
return
utility-tasks.bbclass: Move distro related tasks to distrodata.bbclass Most of the d.keys() used in file parsing are variables in distro_tracking_fields.inc, which are not used in normal build. Therefore remove the inclusion of distro_tracking_fields.inc from poky.conf. Besides, move distro related tasks to distrodata.bbclass, which includes that tracking field file. By this change, the file parsing time could save about 25%. Signed-off-by: Dongxiao Xu <dongxiao.xu@intel.com>
2010-11-22 06:02:37 +00:00
localdata = bb.data.createCopy(d)
bb.data.update_data(localdata)
Convert to use direct access to the data store (instead of bb.data.*Var*()) This is the result of running the following over the metadata: sed \ -e 's:bb.data.\(setVar([^,()]*,[^,()]*\), *\([^ )]*\) *):\2.\1):g' \ -e 's:bb.data.\(setVarFlag([^,()]*,[^,()]*,[^,()]*\), *\([^) ]*\) *):\2.\1):g' \ -e 's:bb.data.\(getVar([^,()]*\), *\([^(), ]*\) *,\([^)]*\)):\2.\1,\3):g' \ -e 's:bb.data.\(getVarFlag([^,()]*,[^,()]*\), *\([^(), ]*\) *,\([^)]*\)):\2.\1,\3):g' \ -e 's:bb.data.\(getVarFlag([^,()]*,[^,()]*\), *\([^() ]*\) *):\2.\1):g' \ -e 's:bb.data.\(getVar([^,()]*\), *\([^) ]*\) *):\2.\1):g' \ -i `grep -ril bb.data *` (From OE-Core rev: b22831fd63164c4db9c0b72934d7d734a6585251) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2011-11-09 15:00:01 +00:00
tmpdir = d.getVar('TMPDIR', True)
utility-tasks.bbclass: Move distro related tasks to distrodata.bbclass Most of the d.keys() used in file parsing are variables in distro_tracking_fields.inc, which are not used in normal build. Therefore remove the inclusion of distro_tracking_fields.inc from poky.conf. Besides, move distro related tasks to distrodata.bbclass, which includes that tracking field file. By this change, the file parsing time could save about 25%. Signed-off-by: Dongxiao Xu <dongxiao.xu@intel.com>
2010-11-22 06:02:37 +00:00
distro_check_dir = os.path.join(tmpdir, "distro_check")
Convert to use direct access to the data store (instead of bb.data.*Var*()) This is the result of running the following over the metadata: sed \ -e 's:bb.data.\(setVar([^,()]*,[^,()]*\), *\([^ )]*\) *):\2.\1):g' \ -e 's:bb.data.\(setVarFlag([^,()]*,[^,()]*,[^,()]*\), *\([^) ]*\) *):\2.\1):g' \ -e 's:bb.data.\(getVar([^,()]*\), *\([^(), ]*\) *,\([^)]*\)):\2.\1,\3):g' \ -e 's:bb.data.\(getVarFlag([^,()]*,[^,()]*\), *\([^(), ]*\) *,\([^)]*\)):\2.\1,\3):g' \ -e 's:bb.data.\(getVarFlag([^,()]*,[^,()]*\), *\([^() ]*\) *):\2.\1):g' \ -e 's:bb.data.\(getVar([^,()]*\), *\([^) ]*\) *):\2.\1):g' \ -i `grep -ril bb.data *` (From OE-Core rev: b22831fd63164c4db9c0b72934d7d734a6585251) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2011-11-09 15:00:01 +00:00
logpath = d.getVar('LOG_DIR', True)
Add a new task checklicense and fix some bugs in distro_check.py distro_check.py: Create a new function called create_log_file to reduce a lot of repeat code in distrodata.bbclass. We needn't to create log file in function save_distro_check_result, because the log file has been generated in check_eventhandler. Another bug is that we maybe access the /tmp/Meego-1.0 before we create this file. Add a judge statement to decide whether we need to create this file firstly. distrodata.bbclass: Add a new task checklicense to collect missing text license information. This can help package-report system to know how many recipes are missing license text. (From OE-Core rev: b41148cda9f0cc292b662a8473f26bc1ee0148f3) Signed-off-by: Mei Lei <lei.mei@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2011-05-16 11:06:21 +00:00
bb.utils.mkdirhier(logpath)
result_file = os.path.join(logpath, "distrocheck.csv")
Convert to use direct access to the data store (instead of bb.data.*Var*()) This is the result of running the following over the metadata: sed \ -e 's:bb.data.\(setVar([^,()]*,[^,()]*\), *\([^ )]*\) *):\2.\1):g' \ -e 's:bb.data.\(setVarFlag([^,()]*,[^,()]*,[^,()]*\), *\([^) ]*\) *):\2.\1):g' \ -e 's:bb.data.\(getVar([^,()]*\), *\([^(), ]*\) *,\([^)]*\)):\2.\1,\3):g' \ -e 's:bb.data.\(getVarFlag([^,()]*,[^,()]*\), *\([^(), ]*\) *,\([^)]*\)):\2.\1,\3):g' \ -e 's:bb.data.\(getVarFlag([^,()]*,[^,()]*\), *\([^() ]*\) *):\2.\1):g' \ -e 's:bb.data.\(getVar([^,()]*\), *\([^) ]*\) *):\2.\1):g' \ -i `grep -ril bb.data *` (From OE-Core rev: b22831fd63164c4db9c0b72934d7d734a6585251) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2011-11-09 15:00:01 +00:00
datetime = localdata.getVar('DATETIME', True)
utility-tasks.bbclass: Move distro related tasks to distrodata.bbclass Most of the d.keys() used in file parsing are variables in distro_tracking_fields.inc, which are not used in normal build. Therefore remove the inclusion of distro_tracking_fields.inc from poky.conf. Besides, move distro related tasks to distrodata.bbclass, which includes that tracking field file. By this change, the file parsing time could save about 25%. Signed-off-by: Dongxiao Xu <dongxiao.xu@intel.com>
2010-11-22 06:02:37 +00:00
dc.update_distro_data(distro_check_dir, datetime)
# do the comparison
result = dc.compare_in_distro_packages_list(distro_check_dir, d)
# save the results
Add a new task checklicense and fix some bugs in distro_check.py distro_check.py: Create a new function called create_log_file to reduce a lot of repeat code in distrodata.bbclass. We needn't to create log file in function save_distro_check_result, because the log file has been generated in check_eventhandler. Another bug is that we maybe access the /tmp/Meego-1.0 before we create this file. Add a judge statement to decide whether we need to create this file firstly. distrodata.bbclass: Add a new task checklicense to collect missing text license information. This can help package-report system to know how many recipes are missing license text. (From OE-Core rev: b41148cda9f0cc292b662a8473f26bc1ee0148f3) Signed-off-by: Mei Lei <lei.mei@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2011-05-16 11:06:21 +00:00
dc.save_distro_check_result(result, datetime, result_file, d)
utility-tasks.bbclass: Move distro related tasks to distrodata.bbclass Most of the d.keys() used in file parsing are variables in distro_tracking_fields.inc, which are not used in normal build. Therefore remove the inclusion of distro_tracking_fields.inc from poky.conf. Besides, move distro related tasks to distrodata.bbclass, which includes that tracking field file. By this change, the file parsing time could save about 25%. Signed-off-by: Dongxiao Xu <dongxiao.xu@intel.com>
2010-11-22 06:02:37 +00:00
}
addtask distro_checkall after do_distro_check
meta/classes: Update recrdeptask fields for recursive dependency handling changes in bitbake This also deletes the buildall task since I seen usecases for it. (From OE-Core rev: 8229fb5d7205f5e5b198ab2860fbcc02054476eb) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-07-02 12:27:46 +00:00
do_distro_checkall[recrdeptask] = "do_distro_checkall do_distro_check"
utility-tasks/distrodata: Add recideptask flag for fetchall/checkuriall See the bitbake commit adding the recideptask flag for details of the problem but in summary, we weren't seeing the [depends] of tasks like do_rootfs being taking into account for fetchall. This was leading to not all sources being fetched and this is the OE-Core part of the fix for this problem. BB_DEFAULT_TASK is the default task used since this is the one that most commands would end up targeting and is how users expect the command to behave. [YOCTO #4597] (From OE-Core rev: abf468963a087244887384122fd5202909e7f118) (From OE-Core rev: e385cc4ac06ac1e8d257563a700d19895105eade) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2013-06-19 13:05:17 +00:00
do_distro_checkall[recideptask] = "do_${BB_DEFAULT_TASK}"
utility-tasks.bbclass: Move distro related tasks to distrodata.bbclass Most of the d.keys() used in file parsing are variables in distro_tracking_fields.inc, which are not used in normal build. Therefore remove the inclusion of distro_tracking_fields.inc from poky.conf. Besides, move distro related tasks to distrodata.bbclass, which includes that tracking field file. By this change, the file parsing time could save about 25%. Signed-off-by: Dongxiao Xu <dongxiao.xu@intel.com>
2010-11-22 06:02:37 +00:00
do_distro_checkall[nostamp] = "1"
do_distro_checkall() {
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
:
utility-tasks.bbclass: Move distro related tasks to distrodata.bbclass Most of the d.keys() used in file parsing are variables in distro_tracking_fields.inc, which are not used in normal build. Therefore remove the inclusion of distro_tracking_fields.inc from poky.conf. Besides, move distro related tasks to distrodata.bbclass, which includes that tracking field file. By this change, the file parsing time could save about 25%. Signed-off-by: Dongxiao Xu <dongxiao.xu@intel.com>
2010-11-22 06:02:37 +00:00
}
Add a new task checklicense and fix some bugs in distro_check.py distro_check.py: Create a new function called create_log_file to reduce a lot of repeat code in distrodata.bbclass. We needn't to create log file in function save_distro_check_result, because the log file has been generated in check_eventhandler. Another bug is that we maybe access the /tmp/Meego-1.0 before we create this file. Add a judge statement to decide whether we need to create this file firstly. distrodata.bbclass: Add a new task checklicense to collect missing text license information. This can help package-report system to know how many recipes are missing license text. (From OE-Core rev: b41148cda9f0cc292b662a8473f26bc1ee0148f3) Signed-off-by: Mei Lei <lei.mei@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2011-05-16 11:06:21 +00:00
#
#Check Missing License Text.
#Use this task to generate the missing license text data for pkg-report system,
#then we can search those recipes which license text isn't exsit in common-licenses directory
#
addhandler checklicense_eventhandler
classes/conf: Add eventmasks for event handlers Now that bitbake supports masking events for event handlers, lets use this so event handlers are only called for events they care about. This lets us simplify the code indentation a bit at least as well as mildly improving the event handling performance. (From OE-Core rev: bff73743280f9eafebe4591f7368ead91a4eb74d) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2013-06-12 16:31:57 +00:00
checklicense_eventhandler[eventmask] = "bb.event.BuildStarted"
Add a new task checklicense and fix some bugs in distro_check.py distro_check.py: Create a new function called create_log_file to reduce a lot of repeat code in distrodata.bbclass. We needn't to create log file in function save_distro_check_result, because the log file has been generated in check_eventhandler. Another bug is that we maybe access the /tmp/Meego-1.0 before we create this file. Add a judge statement to decide whether we need to create this file firstly. distrodata.bbclass: Add a new task checklicense to collect missing text license information. This can help package-report system to know how many recipes are missing license text. (From OE-Core rev: b41148cda9f0cc292b662a8473f26bc1ee0148f3) Signed-off-by: Mei Lei <lei.mei@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2011-05-16 11:06:21 +00:00
python checklicense_eventhandler() {
classes/conf: Add eventmasks for event handlers Now that bitbake supports masking events for event handlers, lets use this so event handlers are only called for events they care about. This lets us simplify the code indentation a bit at least as well as mildly improving the event handling performance. (From OE-Core rev: bff73743280f9eafebe4591f7368ead91a4eb74d) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2013-06-12 16:31:57 +00:00
"""initialize log files."""
import oe.distro_check as dc
logfile = dc.create_log_file(e.data, "missinglicense.csv")
lf = bb.utils.lockfile("%s.lock" % logfile)
f = open(logfile, "a")
f.write("Package\tLicense\tMissingLicense\n")
f.close()
bb.utils.unlockfile(lf)
Add a new task checklicense and fix some bugs in distro_check.py distro_check.py: Create a new function called create_log_file to reduce a lot of repeat code in distrodata.bbclass. We needn't to create log file in function save_distro_check_result, because the log file has been generated in check_eventhandler. Another bug is that we maybe access the /tmp/Meego-1.0 before we create this file. Add a judge statement to decide whether we need to create this file firstly. distrodata.bbclass: Add a new task checklicense to collect missing text license information. This can help package-report system to know how many recipes are missing license text. (From OE-Core rev: b41148cda9f0cc292b662a8473f26bc1ee0148f3) Signed-off-by: Mei Lei <lei.mei@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2011-05-16 11:06:21 +00:00
return
}
addtask checklicense
do_checklicense[nostamp] = "1"
python do_checklicense() {
import shutil
Convert to use direct access to the data store (instead of bb.data.*Var*()) This is the result of running the following over the metadata: sed \ -e 's:bb.data.\(setVar([^,()]*,[^,()]*\), *\([^ )]*\) *):\2.\1):g' \ -e 's:bb.data.\(setVarFlag([^,()]*,[^,()]*,[^,()]*\), *\([^) ]*\) *):\2.\1):g' \ -e 's:bb.data.\(getVar([^,()]*\), *\([^(), ]*\) *,\([^)]*\)):\2.\1,\3):g' \ -e 's:bb.data.\(getVarFlag([^,()]*,[^,()]*\), *\([^(), ]*\) *,\([^)]*\)):\2.\1,\3):g' \ -e 's:bb.data.\(getVarFlag([^,()]*,[^,()]*\), *\([^() ]*\) *):\2.\1):g' \ -e 's:bb.data.\(getVar([^,()]*\), *\([^) ]*\) *):\2.\1):g' \ -i `grep -ril bb.data *` (From OE-Core rev: b22831fd63164c4db9c0b72934d7d734a6585251) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2011-11-09 15:00:01 +00:00
logpath = d.getVar('LOG_DIR', True)
Add a new task checklicense and fix some bugs in distro_check.py distro_check.py: Create a new function called create_log_file to reduce a lot of repeat code in distrodata.bbclass. We needn't to create log file in function save_distro_check_result, because the log file has been generated in check_eventhandler. Another bug is that we maybe access the /tmp/Meego-1.0 before we create this file. Add a judge statement to decide whether we need to create this file firstly. distrodata.bbclass: Add a new task checklicense to collect missing text license information. This can help package-report system to know how many recipes are missing license text. (From OE-Core rev: b41148cda9f0cc292b662a8473f26bc1ee0148f3) Signed-off-by: Mei Lei <lei.mei@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2011-05-16 11:06:21 +00:00
bb.utils.mkdirhier(logpath)
Convert to use direct access to the data store (instead of bb.data.*Var*()) This is the result of running the following over the metadata: sed \ -e 's:bb.data.\(setVar([^,()]*,[^,()]*\), *\([^ )]*\) *):\2.\1):g' \ -e 's:bb.data.\(setVarFlag([^,()]*,[^,()]*,[^,()]*\), *\([^) ]*\) *):\2.\1):g' \ -e 's:bb.data.\(getVar([^,()]*\), *\([^(), ]*\) *,\([^)]*\)):\2.\1,\3):g' \ -e 's:bb.data.\(getVarFlag([^,()]*,[^,()]*\), *\([^(), ]*\) *,\([^)]*\)):\2.\1,\3):g' \ -e 's:bb.data.\(getVarFlag([^,()]*,[^,()]*\), *\([^() ]*\) *):\2.\1):g' \ -e 's:bb.data.\(getVar([^,()]*\), *\([^) ]*\) *):\2.\1):g' \ -i `grep -ril bb.data *` (From OE-Core rev: b22831fd63164c4db9c0b72934d7d734a6585251) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2011-11-09 15:00:01 +00:00
pn = d.getVar('PN', True)
Add a new task checklicense and fix some bugs in distro_check.py distro_check.py: Create a new function called create_log_file to reduce a lot of repeat code in distrodata.bbclass. We needn't to create log file in function save_distro_check_result, because the log file has been generated in check_eventhandler. Another bug is that we maybe access the /tmp/Meego-1.0 before we create this file. Add a judge statement to decide whether we need to create this file firstly. distrodata.bbclass: Add a new task checklicense to collect missing text license information. This can help package-report system to know how many recipes are missing license text. (From OE-Core rev: b41148cda9f0cc292b662a8473f26bc1ee0148f3) Signed-off-by: Mei Lei <lei.mei@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2011-05-16 11:06:21 +00:00
logfile = os.path.join(logpath, "missinglicense.csv")
Convert to use direct access to the data store (instead of bb.data.*Var*()) This is the result of running the following over the metadata: sed \ -e 's:bb.data.\(setVar([^,()]*,[^,()]*\), *\([^ )]*\) *):\2.\1):g' \ -e 's:bb.data.\(setVarFlag([^,()]*,[^,()]*,[^,()]*\), *\([^) ]*\) *):\2.\1):g' \ -e 's:bb.data.\(getVar([^,()]*\), *\([^(), ]*\) *,\([^)]*\)):\2.\1,\3):g' \ -e 's:bb.data.\(getVarFlag([^,()]*,[^,()]*\), *\([^(), ]*\) *,\([^)]*\)):\2.\1,\3):g' \ -e 's:bb.data.\(getVarFlag([^,()]*,[^,()]*\), *\([^() ]*\) *):\2.\1):g' \ -e 's:bb.data.\(getVar([^,()]*\), *\([^) ]*\) *):\2.\1):g' \ -i `grep -ril bb.data *` (From OE-Core rev: b22831fd63164c4db9c0b72934d7d734a6585251) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2011-11-09 15:00:01 +00:00
generic_directory = d.getVar('COMMON_LICENSE_DIR', True)
license_types = d.getVar('LICENSE', True)
Add a new task checklicense and fix some bugs in distro_check.py distro_check.py: Create a new function called create_log_file to reduce a lot of repeat code in distrodata.bbclass. We needn't to create log file in function save_distro_check_result, because the log file has been generated in check_eventhandler. Another bug is that we maybe access the /tmp/Meego-1.0 before we create this file. Add a judge statement to decide whether we need to create this file firstly. distrodata.bbclass: Add a new task checklicense to collect missing text license information. This can help package-report system to know how many recipes are missing license text. (From OE-Core rev: b41148cda9f0cc292b662a8473f26bc1ee0148f3) Signed-off-by: Mei Lei <lei.mei@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2011-05-16 11:06:21 +00:00
for license_type in ((license_types.replace('+', '').replace('|', '&')
.replace('(', '').replace(')', '').replace(';', '')
.replace(',', '').replace(" ", "").split("&"))):
if not os.path.isfile(os.path.join(generic_directory, license_type)):
lf = bb.utils.lockfile("%s.lock" % logfile)
f = open(logfile, "a")
f.write("%s\t%s\t%s\n" % \
(pn,license_types,license_type))
f.close()
bb.utils.unlockfile(lf)
return
}
addtask checklicenseall after do_checklicense
meta/classes: Update recrdeptask fields for recursive dependency handling changes in bitbake This also deletes the buildall task since I seen usecases for it. (From OE-Core rev: 8229fb5d7205f5e5b198ab2860fbcc02054476eb) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-07-02 12:27:46 +00:00
do_checklicenseall[recrdeptask] = "do_checklicenseall do_checklicense"
utility-tasks/distrodata: Add recideptask flag for fetchall/checkuriall See the bitbake commit adding the recideptask flag for details of the problem but in summary, we weren't seeing the [depends] of tasks like do_rootfs being taking into account for fetchall. This was leading to not all sources being fetched and this is the OE-Core part of the fix for this problem. BB_DEFAULT_TASK is the default task used since this is the one that most commands would end up targeting and is how users expect the command to behave. [YOCTO #4597] (From OE-Core rev: abf468963a087244887384122fd5202909e7f118) (From OE-Core rev: e385cc4ac06ac1e8d257563a700d19895105eade) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2013-06-19 13:05:17 +00:00
do_checklicenseall[recideptask] = "do_${BB_DEFAULT_TASK}"
Add a new task checklicense and fix some bugs in distro_check.py distro_check.py: Create a new function called create_log_file to reduce a lot of repeat code in distrodata.bbclass. We needn't to create log file in function save_distro_check_result, because the log file has been generated in check_eventhandler. Another bug is that we maybe access the /tmp/Meego-1.0 before we create this file. Add a judge statement to decide whether we need to create this file firstly. distrodata.bbclass: Add a new task checklicense to collect missing text license information. This can help package-report system to know how many recipes are missing license text. (From OE-Core rev: b41148cda9f0cc292b662a8473f26bc1ee0148f3) Signed-off-by: Mei Lei <lei.mei@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2011-05-16 11:06:21 +00:00
do_checklicenseall[nostamp] = "1"
do_checklicenseall() {
distrodata: replace Tab with Space (From OE-Core rev: adb241958f125cc4c74ac5fbfc00674e7cd7305d) Signed-off-by: Saul Wold <sgw@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-09-10 06:53:46 +00:00
:
Add a new task checklicense and fix some bugs in distro_check.py distro_check.py: Create a new function called create_log_file to reduce a lot of repeat code in distrodata.bbclass. We needn't to create log file in function save_distro_check_result, because the log file has been generated in check_eventhandler. Another bug is that we maybe access the /tmp/Meego-1.0 before we create this file. Add a judge statement to decide whether we need to create this file firstly. distrodata.bbclass: Add a new task checklicense to collect missing text license information. This can help package-report system to know how many recipes are missing license text. (From OE-Core rev: b41148cda9f0cc292b662a8473f26bc1ee0148f3) Signed-off-by: Mei Lei <lei.mei@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2011-05-16 11:06:21 +00:00
}