Hi Brian, Was there an instance of bitbake running in your build folder before you triggered the build from toaster?
Thanks, Sujith H On Wed, Sep 2, 2015 at 2:12 PM, sujith h <[email protected]> wrote: > > > On Tue, Sep 1, 2015 at 10:39 PM, Brian Avery <[email protected]> > wrote: > >> Hi, >> >> I'm on the correct patch afaik. I put the toasterconf.json into the >> directory above poky and loaded it with: >> poky/bitbake/lib/toaster/manage.py loadconf >> /home/bavery/src/intel/myBugs2/sujith/toasterconf.json >> > > This is not my latest patch which I worked on :) It was with subject: [PATCH] > toaster: Import external layers outside poky from toasterconf.json > > >> I also used option 0 so that toaster did not attempt to load the >> layers from openembedded. >> >> My branch for this test is: >> >> http://git.yoctoproject.org/cgit/cgit.cgi/poky-contrib/?h=bavery%2Fsubmit%2Fsujith%2F20150827_custom_layer_import >> >> I ran a build of core-image-sato with qtbase and iw set in >> IMAGE_INSTALL_append for the project. >> >> The results: >> The good- >> I got a core-image-sato as well as the qt5 and iw packages; so the build >> worked. >> >> The not so good - >> 1) My build progress bar did not update. >> 2) my recipe list after the build looks like: >> >> https://www.dropbox.com/s/qs7hulsbmcgg4ik/Screenshot%202015-09-01%2010.02.29.png?dl=0 >> 3) in the build directory I set when starting up toaster (where the >> tmp/deploy ends up among other things) the toaster_ui.log file was >> filled with errors (it ended up being 17G by the end of the build). >> I'm attaching the first 120 lines of it so you can see what it looked >> like. >> >> I would like to share my poky and cloned_layers directory and the ui log > file attached: > > ------------ > sujith@kdekidd0:~/MEL/test_poky$ pwd > /home/sujith/MEL/test_poky > sujith@kdekidd0:~/MEL/test_poky$ ls -lt > total 16488 > -rw-r--r-- 1 sujith sujith 16855040 Sep 2 13:46 toaster.sqlite > drwxrwxr-x 3 sujith sujith 4096 Sep 2 13:45 toaster_build_artifacts > drwxr-xr-x 8 sujith sujith 4096 Sep 2 13:43 build > drwxrwxr-x 11 sujith sujith 4096 Sep 2 10:01 poky > -rw-rw-r-- 1 sujith sujith 4632 Aug 28 12:21 toasterconf.json > drwxrwxr-x 6 sujith sujith 4096 Aug 28 11:53 venv > sujith@kdekidd0:~/MEL/test_poky$ ls ../cloned_layers/ -l > total 8 > drwxrwxr-x 19 sujith sujith 4096 Aug 28 11:51 meta-oe > drwxrwxr-x 8 sujith sujith 4096 Aug 28 12:10 meta-qt5 > sujith@kdekidd0:~/MEL/test_poky$ > ------------ > > Now the step done to load configuration: > > ------------ > sujith@kdekidd0:~/MEL/test_poky$ source venv/bin/activate > (venv)sujith@kdekidd0:~/MEL/test_poky$ ./poky/bitbake/bin/toaster > Syncing... > Creating tables ... > Creating table auth_permission > Creating table auth_group_permissions > Creating table auth_group > Creating table auth_user_groups > Creating table auth_user_user_permissions > Creating table auth_user > Creating table django_content_type > Creating table django_session > Creating table django_admin_log > Creating table south_migrationhistory > > You just installed Django's auth system, which means you don't have any > superusers defined. > Would you like to create one now? (yes/no): yes > Username (leave blank to use 'sujith'): > Email address: > Password: > Password (again): > Superuser created successfully. > Installing custom SQL ... > Installing indexes ... > Installed 0 object(s) from 0 fixture(s) > > Synced: > > django.contrib.auth > > django.contrib.contenttypes > > django.contrib.messages > > django.contrib.sessions > > django.contrib.admin > > django.contrib.staticfiles > > django.contrib.humanize > > south > > Not synced (use migrations): > - bldcontrol > - orm > (use ./manage.py migrate to migrate these) > Running migrations for orm: > - Migrating forwards to 0024_auto__add_field_recipe_is_image. > > orm:0001_initial > > orm:0002_auto__add_field_build_timespent > > orm:0003_timespent > - Migration 'orm:0003_timespent' is marked for no-dry-run. > > orm:0004_auto__add_field_package_installed_name > > > orm:0005_auto__add_target_image_file__add_target_file__add_field_variablehistor > > > orm:0006_auto__add_field_target_image_size__add_field_target_license_manifest_p > > orm:0007_auto__add_helptext > > > orm:0008_auto__chg_field_variablehistory_operation__chg_field_recipe_descriptio > > > orm:0009_auto__add_projectvariable__add_projectlayer__add_projecttarget__add_pr > > > orm:0010_auto__add_field_project_branch__add_field_project_short_description__a > > orm:0011_auto__add_field_projectlayer_dirpath > > > orm:0012_auto__add_field_projectlayer_optional__add_field_projecttarget_task > > > orm:0013_auto__add_release__add_layerversiondependency__add_unique_layerversion > > > orm:0014_auto__chg_field_package_summary__chg_field_layer_summary__chg_field_re > > > orm:0015_auto__add_field_layer_vcs_web_url__add_field_layer_vcs_web_tree_base_u > > > orm:0016_auto__add_field_release_helptext__chg_field_release_branch__add_index_ > > > orm:0017_auto__del_toastersettingdefaultlayer__add_releaselayersourcepriority__ > > orm:0018_auto__add_field_layer_version_project > > orm:0019_auto__add_buildartifact > > > orm:0020_auto__add_field_layer_version_local_path__add_field_recipe_pathflags__ > > > orm:0021_auto__chg_field_build_project__chg_field_project_bitbake_version__chg_ > > > orm:0022_auto__add_field_target_task__add_field_layer_version_local_path__del_f > > > orm:0023_auto__del_field_build_warnings_no__del_field_build_errors_no__del_fiel > > orm:0024_auto__add_field_recipe_is_image > - Loading initial data for orm. > Installed 0 object(s) from 0 fixture(s) > Running migrations for bldcontrol: > - Migrating forwards to 0008_brarchive. > > bldcontrol:0001_initial > > > bldcontrol:0002_auto__add_field_buildenvironment_sourcedir__add_field_buildenvironment > > bldcontrol:0003_auto__add_field_brlayer_dirpath > > bldcontrol:0004_loadinitialdata > - Migration 'bldcontrol:0004_loadinitialdata' is marked for no-dry-run. > > bldcontrol:0005_auto__add_brerror > > bldcontrol:0006_auto__add_brbitbake > > > bldcontrol:0007_auto__add_field_buildrequest_environment__chg_field_buildrequest_build > > bldcontrol:0008_brarchive > - Migration 'bldcontrol:0008_brarchive' is marked for no-dry-run. > - Loading initial data for bldcontrol. > Installed 0 object(s) from 0 fixture(s) > Toaster needs to know in which directory it can download build log files > and other artifacts. > Toaster suggests "/home/sujith/MEL/test_poky/toaster_build_artifacts/". > Press Enter to select > "/home/sujith/MEL/test_poky/toaster_build_artifacts/" or type the full path > to a different directory: > Verifying the Build Environment. If the local Build Environment is not > properly configured, you will be asked to configure it. > > -- Validation: The checkout directory must be set. > Toaster needs to know in which directory it should check out the layers > that will be needed for your builds. > Toaster suggests "/home/sujith". If you select this directory, a layer > like "meta-intel" will end up in "/home/sujith/meta-intel". > Press Enter to select "/home/sujith" or type the full path to a different > directory (must be a parent of current checkout directory): > Verifying the Build Environment. If the local Build Environment is not > properly configured, you will be asked to configure it. > > -- Validation: The build directory must be set. > Toaster needs to know where is your build directory. > The build directory is where all the artifacts created by your builds > will be stored. Type the full path to the directory (for example: " > /home/sujith/build")/home/sujith/MEL/test_poky/build > Build configuration saved > Verifying the Build Environment. If the local Build Environment is not > properly configured, you will be asked to configure it. > > Toaster can use a SINGLE predefined configuration file to set up default > project settings and layer information sources. > > Toaster will list now the configuration files that it found. Select the > number to use the desired configuration file. > [1] - /home/sujith/MEL/toaster_work/poky/meta-yocto/conf/toasterconf.json > [2] - /home/sujith/MEL/cedar/poky/meta-yocto/conf/toasterconf.json > [3] - > /home/sujith/MEL/toaster_MEL_final/poky/meta-yocto/conf/toasterconf.json > [4] - /home/sujith/MEL/test_poky/poky/meta-yocto/conf/toasterconf.json > [5] - > /home/sujith/MEL/upstream_poky_work/poky-contrib/meta-yocto/conf/toasterconf.json > [6] - /home/sujith/gitroot/poky/meta-yocto/conf/toasterconf.json > > [0] - Exit without importing any file > > Enter your option: 0 > Starting webserver... > Webserver address: http://0.0.0.0:8000/ > Starting browser... > Toaster is now running. You can stop it with Ctrl-C > ^Z > [1]+ Stopped ./poky/bitbake/bin/toaster > (venv)sujith@kdekidd0:~/MEL/test_poky$ > ./poky/bitbake/lib/toaster/manage.py loadconf toasterconf.json > (venv)sujith@kdekidd0:~/MEL/test_poky$ fg > ./poky/bitbake/bin/toaster > 2015-09-02 10:11:54,415 DEBUG localhostbecontroller, our git repos are > {(u'', u'HEAD'): [('bitbake', u'bitbake')], > (u'git://git.yoctoproject.org/poky', u'HEAD'): [(u'openembedded-core', > u'meta'), > (u'meta-yocto', > u'meta-yocto'), > (u'meta-yocto-bsp', > u'meta-yocto-bsp')], > (u'git://github.com/meta-qt5/meta-qt5.git', u'HEAD'): [(u'meta-qt5', > u'meta-qt5')], > (u'git://github.com/openembedded/meta-oe.git', u'HEAD'): > [(u'meta-python', > > u'meta-python'), > > (u'meta-multimedia', > > u'meta-multimedia'), > > (u'meta-filesystems', > > u'meta-filesystems'), > > (u'meta-networking', > > u'meta-networking'), > (u'meta-oe', > u'meta-oe')]} > 2015-09-02 10:11:54,416 DEBUG lbc_shellcmmd: (/home/sujith/Documents) git > remote -v > 2015-09-02 10:11:54,419 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,419 DEBUG lbc_shellcmmd: (/home/sujith/.thumbnails) > git remote -v > 2015-09-02 10:11:54,422 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,422 DEBUG lbc_shellcmmd: (/home/sujith/.emacs.d) git > remote -v > 2015-09-02 10:11:54,425 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,425 DEBUG lbc_shellcmmd: (/home/sujith/Templates) git > remote -v > 2015-09-02 10:11:54,429 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,429 DEBUG lbc_shellcmmd: (/home/sujith/.pylint.d) git > remote -v > 2015-09-02 10:11:54,432 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,432 DEBUG lbc_shellcmmd: (/home/sujith/.cscache) git > remote -v > 2015-09-02 10:11:54,439 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,439 DEBUG lbc_shellcmmd: (/home/sujith/.config) git > remote -v > 2015-09-02 10:11:54,443 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,443 DEBUG lbc_shellcmmd: (/home/sujith/bin) git remote > -v > 2015-09-02 10:11:54,448 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,448 DEBUG lbc_shellcmmd: (/home/sujith/MEL) git remote > -v > 2015-09-02 10:11:54,452 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,452 DEBUG lbc_shellcmmd: (/home/sujith/Pictures) git > remote -v > 2015-09-02 10:11:54,455 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,455 DEBUG lbc_shellcmmd: (/home/sujith/.pip) git > remote -v > 2015-09-02 10:11:54,459 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,459 DEBUG lbc_shellcmmd: (/home/sujith/Music) git > remote -v > 2015-09-02 10:11:54,463 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,463 DEBUG lbc_shellcmmd: (/home/sujith/debian) git > remote -v > 2015-09-02 10:11:54,466 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,466 DEBUG lbc_shellcmmd: (/home/sujith/.distlib) git > remote -v > 2015-09-02 10:11:54,470 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,470 DEBUG lbc_shellcmmd: (/home/sujith/.mozilla) git > remote -v > 2015-09-02 10:11:54,473 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,474 DEBUG lbc_shellcmmd: (/home/sujith/Django_study) > git remote -v > 2015-09-02 10:11:54,478 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,478 DEBUG lbc_shellcmmd: (/home/sujith/.java) git > remote -v > 2015-09-02 10:11:54,481 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,482 DEBUG lbc_shellcmmd: > (/home/sujith/patches_to_push) git remote -v > 2015-09-02 10:11:54,485 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,485 DEBUG lbc_shellcmmd: (/home/sujith/.ssh) git > remote -v > 2015-09-02 10:11:54,488 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,488 DEBUG lbc_shellcmmd: (/home/sujith/Downloads) git > remote -v > 2015-09-02 10:11:54,492 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,492 DEBUG lbc_shellcmmd: (/home/sujith/.pki) git > remote -v > 2015-09-02 10:11:54,495 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,496 DEBUG lbc_shellcmmd: (/home/sujith/Public) git > remote -v > 2015-09-02 10:11:54,499 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,499 DEBUG lbc_shellcmmd: (/home/sujith/.repoconfig) > git remote -v > 2015-09-02 10:11:54,502 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,502 DEBUG lbc_shellcmmd: (/home/sujith/.pc) git remote > -v > 2015-09-02 10:11:54,505 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,505 DEBUG lbc_shellcmmd: (/home/sujith/wsgiref) git > remote -v > 2015-09-02 10:11:54,510 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,510 DEBUG lbc_shellcmmd: (/home/sujith/.mentor) git > remote -v > 2015-09-02 10:11:54,513 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,515 DEBUG lbc_shellcmmd: > (/home/sujith/MENTOR_TOOLCHAIN) git remote -v > 2015-09-02 10:11:54,517 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,518 DEBUG lbc_shellcmmd: (/home/sujith/Desktop) git > remote -v > 2015-09-02 10:11:54,521 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,521 DEBUG lbc_shellcmmd: (/home/sujith/.local) git > remote -v > 2015-09-02 10:11:54,525 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,525 DEBUG lbc_shellcmmd: (/home/sujith/.dbus) git > remote -v > 2015-09-02 10:11:54,529 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,529 DEBUG lbc_shellcmmd: (/home/sujith/workspace) git > remote -v > 2015-09-02 10:11:54,532 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,533 DEBUG lbc_shellcmmd: > (/home/sujith/.gstreamer-0.10) git remote -v > 2015-09-02 10:11:54,536 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,536 DEBUG lbc_shellcmmd: (/home/sujith/.gnome) git > remote -v > 2015-09-02 10:11:54,540 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,540 DEBUG lbc_shellcmmd: (/home/sujith/.cache) git > remote -v > 2015-09-02 10:11:54,544 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,544 DEBUG lbc_shellcmmd: > (/home/sujith/codebench-linux-install-2014.11-96-arm) git remote -v > 2015-09-02 10:11:54,547 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,547 DEBUG lbc_shellcmmd: (/home/sujith/Videos) git > remote -v > 2015-09-02 10:11:54,550 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,550 DEBUG lbc_shellcmmd: (/home/sujith/.gconf) git > remote -v > 2015-09-02 10:11:54,554 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,555 DEBUG lbc_shellcmmd: (/home/sujith/.subversion) > git remote -v > 2015-09-02 10:11:54,558 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,558 DEBUG lbc_shellcmmd: (/home/sujith/.thunderbird) > git remote -v > 2015-09-02 10:11:54,561 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,561 DEBUG lbc_shellcmmd: (/home/sujith/gitroot) git > remote -v > 2015-09-02 10:11:54,564 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,564 DEBUG lbc_shellcmmd: (/home/sujith/.oe) git remote > -v > 2015-09-02 10:11:54,568 WARNING localhostbecontroller: shellcmd error > command: git remote -v > fatal: Not a git repository (or any of the parent directories): .git > > 2015-09-02 10:11:54,570 DEBUG localhostbecontroller: current layer list > [u'/home/sujith/MEL/test_poky/poky/meta', > u'/home/sujith/MEL/test_poky/poky/meta-yocto', > u'/home/sujith/MEL/test_poky/poky/meta-yocto-bsp', > u'/home/sujith/MEL/cloned_layers/meta-oe/meta-python', > u'/home/sujith/MEL/cloned_layers/meta-oe/meta-multimedia', > u'/home/sujith/MEL/cloned_layers/meta-oe/meta-filesystems', > u'/home/sujith/MEL/cloned_layers/meta-oe/meta-networking', > u'/home/sujith/MEL/cloned_layers/meta-oe/meta-oe', > u'/home/sujith/MEL/cloned_layers/meta-qt5'] > 2015-09-02 10:11:54,571 DEBUG lbc_shellcmmd: (/home/sujith) bash -c > "source /home/sujith/MEL/test_poky/poky/oe-init-build-env > /home/sujith/MEL/test_poky/build" > 2015-09-02 10:11:54,684 DEBUG localhostbecontroller: shellcmd success > 2015-09-02 10:11:54,691 DEBUG localhostbecontroller: running the listener > at /home/sujith/MEL/test_poky/poky/bitbake/bin/bitbake > 2015-09-02 10:11:54,691 DEBUG localhostbecontroller: starting builder > bash -c "source /home/sujith/MEL/test_poky/poky/oe-init-build-env > /home/sujith/MEL/test_poky/build 2>&1 >toaster_server.log && bitbake --read > /home/sujith/MEL/test_poky/build/conf/toaster-pre.conf --postread > /home/sujith/MEL/test_poky/build/conf/toaster.conf --server-only -t xmlrpc > -B 0.0.0.0:0 2>&1 >>toaster_server.log " > > 2015-09-02 10:11:54,691 DEBUG lbc_shellcmmd: (/home/sujith) bash -c > "source /home/sujith/MEL/test_poky/poky/oe-init-build-env > /home/sujith/MEL/test_poky/build 2>&1 >toaster_server.log && bitbake --read > /home/sujith/MEL/test_poky/build/conf/toaster-pre.conf --postread > /home/sujith/MEL/test_poky/build/conf/toaster.conf --server-only -t xmlrpc > -B 0.0.0.0:0 2>&1 >>toaster_server.log " > 2015-09-02 10:11:56,198 DEBUG localhostbecontroller: shellcmd success > 2015-09-02 10:11:56,199 DEBUG localhostbecontroller: Found bitbake server > port 33000 > > 2015-09-02 10:11:56,200 DEBUG localhostbecontroller: Waiting bitbake > server to start > 2015-09-02 10:11:56,701 DEBUG localhostbecontroller: Waiting bitbake > server to start > 2015-09-02 10:11:57,202 DEBUG localhostbecontroller: Waiting bitbake > server to start > 2015-09-02 10:11:57,704 DEBUG localhostbecontroller: Waiting bitbake > server to start > 2015-09-02 10:11:58,205 DEBUG localhostbecontroller: Started bitbake server > 2015-09-02 10:11:58,236 DEBUG localhostbecontroller: Build launched, > exiting. Follow build logs at > /home/sujith/MEL/test_poky/build/toaster_ui.log > ------------ > > The path to tmp/deploy/image and the content inside the directory: > > ------------ > sujith@kdekidd0:~/MEL/test_poky/build$ ls tmp/deploy/images/qemux86/ -lt > total 1244112 > lrwxrwxrwx 1 sujith sujith 53 Sep 2 13:43 > core-image-sato-qemux86.tar.bz2 -> > core-image-sato-qemux86-20150902044346.rootfs.tar.bz2 > lrwxrwxrwx 1 sujith sujith 50 Sep 2 13:43 > core-image-sato-qemux86.ext3 -> > core-image-sato-qemux86-20150902044346.rootfs.ext3 > lrwxrwxrwx 1 sujith sujith 50 Sep 2 13:43 > core-image-sato-qemux86.ext4 -> > core-image-sato-qemux86-20150902044346.rootfs.ext4 > lrwxrwxrwx 1 sujith sujith 54 Sep 2 13:43 > core-image-sato-qemux86.manifest -> > core-image-sato-qemux86-20150902044346.rootfs.manifest > lrwxrwxrwx 1 sujith sujith 51 Sep 2 13:43 > core-image-sato-qemux86.jffs2 -> > core-image-sato-qemux86-20150902044346.rootfs.jffs2 > -rw-r--r-- 1 sujith sujith 196083712 Sep 2 13:43 > core-image-sato-qemux86-20150902044346.rootfs.jffs2 > -rw-r--r-- 1 sujith sujith 535930880 Sep 2 13:42 > core-image-sato-qemux86-20150902044346.rootfs.ext4 > -rw-r--r-- 1 sujith sujith 535930880 Sep 2 13:42 > core-image-sato-qemux86-20150902044346.rootfs.ext3 > -rw-r--r-- 1 sujith sujith 154285168 Sep 2 13:42 > core-image-sato-qemux86-20150902044346.rootfs.tar.bz2 > -rw-r--r-- 1 sujith sujith 21112 Sep 2 13:41 > core-image-sato-qemux86-20150902044346.rootfs.manifest > -rw-r--r-- 2 sujith sujith 294 Sep 2 13:40 > README_-_DO_NOT_DELETE_FILES_IN_THIS_DIRECTORY.txt > lrwxrwxrwx 1 sujith sujith 71 Sep 2 12:53 bzImage -> > bzImage--4.1.6+git0+429f9e2ff0_59b8c4f5e8-r0-qemux86-20150902044346.bin > lrwxrwxrwx 1 sujith sujith 71 Sep 2 12:53 bzImage-qemux86.bin -> > bzImage--4.1.6+git0+429f9e2ff0_59b8c4f5e8-r0-qemux86-20150902044346.bin > lrwxrwxrwx 1 sujith sujith 71 Sep 2 12:53 modules-qemux86.tgz -> > modules--4.1.6+git0+429f9e2ff0_59b8c4f5e8-r0-qemux86-20150902044346.tgz > -rw-rw-r-- 2 sujith sujith 83308568 Sep 2 12:53 > modules--4.1.6+git0+429f9e2ff0_59b8c4f5e8-r0-qemux86-20150902044346.tgz > -rw-r--r-- 2 sujith sujith 6957488 Sep 2 12:53 > bzImage--4.1.6+git0+429f9e2ff0_59b8c4f5e8-r0-qemux86-20150902044346.bin > sujith@kdekidd0:~/MEL/test_poky/build$ > ------------ > > The screenshot of image built successfully: http://i.imgur.com/V3qtXFh.png > >> --- >> So, you may want to look at/try my poky-contrib branch and look >> closely at my toasterconf.json file to see if you can tell why you do >> not see these issues. >> > > The toaster-pre.conf of mine looks as: > sujith@kdekidd0:~/MEL/test_poky/build/conf$ cat toaster-pre.conf > IMAGE_INSTALL_append=" qtbase iw" > PACKAGE_CLASSES="package_ipk" > MACHINE="qemux86" > SDKMACHINE="x86_64" > DISTRO="poky" > IMAGE_FSTYPES="ext3 jffs2 tar.bz2" > TOASTER_BRBE="1:1" > sujith@kdekidd0:~/MEL/test_poky/build/conf$ > > Somehow I am not able to figure out what is going on wrong at your end :( > >> >> -brian >> >> On Sun, Aug 30, 2015 at 11:47 PM, sujith h <[email protected]> wrote: >> > Hi Brian, >> > >> > On Sat, Aug 29, 2015 at 1:13 AM, Brian Avery <[email protected]> >> wrote: >> >> >> >> Hi Sujith, >> >> >> >> The new toasterconf does make it easier to test, thanks! I've >> >> attached mine so you can see what I did in case that caused any of the >> >> issues below. >> >> I changed: >> >> 1) directory paths >> >> 2) you had "branches": ["mel", "yocto", "HEAD"], which i >> >> changed to "branches": ["HEAD", "master", "fido", >> >> "dizzy"], >> >> >> >> >> >> >> >> So here is my directory layout >> >> >> >> /big/src/intel/myBugs2 >> >> cloned_layers/ >> >> meta-oe/ >> >> meta-qt5/ >> >> sujith/ >> >> poky >> > >> > >> > Here is my directory layout: >> > /home/sujith/MEL/test_poky >> > poky >> > /home/sujith/MEL/cloned_layers >> > meta-oe >> > meta-qt5 >> > >> >> >> >> >> >> I put the attached toasterconf.json into the sujith/meta-yocto/conf/ >> >> directory (overwriting the default one) and toaster found it on >> >> startup. >> > >> > >> > I have added my configuration into: >> > /home/sujith/MEL/test_poky/toasterconf.json >> > >> > I never tried over writing toasterconf.json file in meta-yocto/conf >> > >> > I use option [0] while running poky/bitbake/bin/toaster i.e, exit >> without >> > importing any layers. Then I manually try to import it using command: >> > poky/bitbake/lib/toaster/manage.py loadconf toasterconf.json >> > >> >> Question: >> >> Where are you putting your toasterconf.json file? I haven't gone >> >> through the search logic yet but toaster seemed to have trouble >> >> finding it in other directories. >> >> >> >> My directory settings for starting toaster are: >> >> build log -> /home/bavery/toaster_build_artifacts >> >> layer checkout -> /big/src/intel/myBugs2/sujith/ >> >> build -> /home/bavery/toaster_build_artifacts >> >> >> >> >> >> I found the following issues: >> >> 1)On startup toaster complained about not being able to load from >> >> openembedded.layers.org and once toaster was up, there were no layers >> >> available except the local ones. >> >> >> >> ( >> https://www.dropbox.com/s/jdkayha71l8i9fe/Screenshot%202015-08-28%2012.29.06.png?dl=0 >> ) >> >> 2) I started a build of core-image-sato with MAGE_INSTALL_append = >> >> "qt5 iws" >> >> ( >> https://www.dropbox.com/s/m3l6uyxq6ptr5vv/Screenshot%202015-08-28%2012.32.16.png?dl=0 >> ) >> >> and the build no longer shows progress on the progress bar. top >> >> running shows that I am well into the build but that is not reflected >> >> in the UI >> >> ( >> https://www.dropbox.com/s/x3cl2whp2twt8xm/Screenshot%202015-08-28%2012.32.44.png?dl=0 >> ) >> >> 3) the toaster_ui.log in the build directory is huge and is filled >> >> with things like :Cannot determine the vcs_reference for layer version >> >> {'build_id': 1, '_layer_cache': <Layer: __FIXME__unidentified_layer / >> >> None >, 'layer_id': 204, '_state': <django.db.models.base.ModelSt...." >> >> >> >> >> >> >> >> Do you see any of these? >> > >> > >> > Since I haven't tried overwriting toasters default configuration file, I >> > couldn't hit with any of these errors. Would you mind to try with my >> way, if >> > you don't mind? >> > Let me know if you face any issue with the procedure I followed. >> > >> > >> > Thanks, >> > Sujith H >> >> >> >> >> >> -b >> >> >> >> On Fri, Aug 28, 2015 at 12:06 AM, sujith h <[email protected]> wrote: >> >> > >> >> > >> >> > On Thu, Aug 27, 2015 at 9:56 PM, sujith h <[email protected]> >> wrote: >> >> >> >> >> >> >> >> >> >> >> >> On Thu, Aug 27, 2015 at 9:36 PM, Brian Avery <[email protected] >> > >> >> >> wrote: >> >> >>> >> >> >>> Hi Sujith, >> >> >>> >> >> >>> I'd like to test this out. Is it possible to get a config file >> that >> >> >>> exercises the new features? >> >> >> >> >> >> >> >> >> I have attached the toaster configuration file which I used for >> >> >> testing. >> >> >> What you can also do is remove meta-mentor,meta-sourcery and >> meta-mx6q >> >> >> layers from the >> >> >> configuration file. And try with the layers we have. That might help >> >> >> you >> >> >> in testing. Also you >> >> >> may have to remove some additional settings I have used in the >> >> >> configuration, like Distro as "mel", >> >> >> toolchain path etc >> >> >> >> >> >> Or the simplest testing would be by adding poky and meta-oe layer. >> Then >> >> >> try to build >> >> >> some recipe from meta-oe. That would be the simplest test. >> >> >> >> >> >> Let me know if you need more information or face any issues. I would >> >> >> help >> >> >> you with that. >> >> > >> >> > >> >> > Hi Brian, >> >> > >> >> > I have attached a new configuration file which I am testing right >> away. >> >> > The >> >> > build is in progress. >> >> > In the IMAGE_INSTALL_append ( from UI ), I have added qtbase and iw >> >> > packages. The 2 repos I have >> >> > cloned is: >> >> > git clone git://github.com/meta-qt5/meta-qt5.git >> >> > and >> >> > git clone git://github.com/openembedded/meta-oe.git >> >> > >> >> > Accordingly adjust your paths mentioned in the configuration file. >> >> > >> >> > I hope this configuration file should help you proceed with your >> test. >> >> > Let >> >> > me know if you face any issues. >> >> > >> >> > Thanks, >> >> > Sujith H >> >> >> >> >> >> >> >> >> Thanks, >> >> >> Sujith H >> >> >>> >> >> >>> >> >> >>> -b >> >> >>> >> >> >>> >> >> >>> On Mon, Aug 24, 2015 at 7:16 PM, sujith h <[email protected]> >> wrote: >> >> >>> > On 24 Aug 2015 6:49 pm, "sujith h" <[email protected]> wrote: >> >> >>> >> >> >> >>> >> >> >> >>> >> >> >> >>> >> On Fri, Aug 21, 2015 at 8:07 PM, Damian, Alexandru >> >> >>> >> <[email protected]> wrote: >> >> >>> >>> >> >> >>> >>> >> >> >>> >>> >> >> >>> >>> On Fri, Aug 21, 2015 at 1:52 PM, sujith h <[email protected]> >> >> >>> >>> wrote: >> >> >>> >>>> >> >> >>> >>>> >> >> >>> >>>> >> >> >>> >>>> On Fri, Aug 21, 2015 at 4:45 PM, Damian, Alexandru >> >> >>> >>>> <[email protected]> wrote: >> >> >>> >>>>> >> >> >>> >>>>> Hi, >> >> >>> >>>>> >> >> >>> >>>>> I think we need a better patch description. If I understand >> >> >>> >>>>> correctly, >> >> >>> >>>>> the issue you were facing is: >> >> >>> >>>>> - even if we have layers at HEAD that are not under the poky/ >> >> >>> >>>>> tree, >> >> >>> >>>>> the >> >> >>> >>>>> code would always return the >> >> >>> >>>>> checkout path in the poky/ tree; I recognize that this is a >> >> >>> >>>>> valid >> >> >>> >>>>> issue. >> >> >>> >>>>> >> >> >>> >>>>> I feel that this issue can be handled a bit differently if we >> >> >>> >>>>> frame >> >> >>> >>>>> it >> >> >>> >>>>> as such: >> >> >>> >>>>> - if we have a HEAD branch specified for a layer, we need to >> >> >>> >>>>> find >> >> >>> >>>>> out >> >> >>> >>>>> the current checkout directory for that layer, since no >> checkout >> >> >>> >>>>> would be >> >> >>> >>>>> performed. >> >> >>> >>>>> >> >> >>> >>>>> As such, when we import a toasterconf.json file (they only >> way >> >> >>> >>>>> to >> >> >>> >>>>> get >> >> >>> >>>>> HEAD branches for a layer) we need to store the actual layer >> >> >>> >>>>> checkout path >> >> >>> >>>>> in the database (in the localpath, perhaps?), and reuse that >> >> >>> >>>>> value, >> >> >>> >>>>> instead >> >> >>> >>>>> of employing special logic to search for it. What I mean, the >> >> >>> >>>>> core >> >> >>> >>>>> of the >> >> >>> >>>>> problem is solved by replacing the whole gitrepos checkout >> logic >> >> >>> >>>>> with a >> >> >>> >>>>> database value for all "HEAD" layers, and eliminate the >> magic in >> >> >>> >>>>> getGitCloneDirectory(). >> >> >>> >>>>> >> >> >>> >>>>> I have a couple more comments on the patch below. >> >> >>> >>>>> >> >> >>> >>>>> Cheers, >> >> >>> >>>>> Alex >> >> >>> >>>>> >> >> >>> >>>>> On Fri, Aug 21, 2015 at 9:41 AM, Sujith H < >> [email protected]> >> >> >>> >>>>> wrote: >> >> >>> >>>>>> >> >> >>> >>>>>> This patch fixes import of custom layers from >> toasterjson.conf >> >> >>> >>>>>> file. For example it was verified using layers like >> >> >>> >>>>>> meta-mentor, >> >> >>> >>>>>> meta-fsl-arm, meta-sourcery etc. >> >> >>> >>>>>> >> >> >>> >>>>>> Signed-off-by: Sujith Haridasan < >> [email protected]> >> >> >>> >>>>>> --- >> >> >>> >>>>>> .../toaster/bldcontrol/localhostbecontroller.py | 49 >> >> >>> >>>>>> ++++++++++++++++++++-- >> >> >>> >>>>>> .../bldcontrol/management/commands/loadconf.py | 12 >> ++++-- >> >> >>> >>>>>> 2 files changed, 54 insertions(+), 7 deletions(-) >> >> >>> >>>>>> >> >> >>> >>>>>> diff --git >> >> >>> >>>>>> a/bitbake/lib/toaster/bldcontrol/localhostbecontroller.py >> >> >>> >>>>>> b/bitbake/lib/toaster/bldcontrol/localhostbecontroller.py >> >> >>> >>>>>> index 231a7d3..c43f33f 100644 >> >> >>> >>>>>> --- >> a/bitbake/lib/toaster/bldcontrol/localhostbecontroller.py >> >> >>> >>>>>> +++ >> b/bitbake/lib/toaster/bldcontrol/localhostbecontroller.py >> >> >>> >>>>>> @@ -178,7 +178,7 @@ class >> >> >>> >>>>>> LocalhostBEController(BuildEnvironmentController): >> >> >>> >>>>>> self.be.save() >> >> >>> >>>>>> logger.debug("localhostbecontroller: Stopped >> bitbake >> >> >>> >>>>>> server") >> >> >>> >>>>>> >> >> >>> >>>>>> - def getGitCloneDirectory(self, url, branch): >> >> >>> >>>>>> + def >> >> >>> >>>>>> >> >> >>> >>>>>> getGitCloneDirectory(self, url, branch, cached_layers=None): >> >> >>> >>>>>> """ Utility that returns the last component of a >> git >> >> >>> >>>>>> path >> >> >>> >>>>>> as >> >> >>> >>>>>> directory >> >> >>> >>>>>> """ >> >> >>> >>>>>> import re >> >> >>> >>>>>> @@ -191,6 +191,17 @@ class >> >> >>> >>>>>> LocalhostBEController(BuildEnvironmentController): >> >> >>> >>>>>> >> >> >>> >>>>>> # word of attention; this is a localhost-specific >> >> >>> >>>>>> issue; >> >> >>> >>>>>> only >> >> >>> >>>>>> on the localhost we expect to have "HEAD" releases >> >> >>> >>>>>> # which _ALWAYS_ means the current poky checkout >> >> >>> >>>>>> + if cached_layers: >> >> >>> >>>>> >> >> >>> >>>>> >> >> >>> >>>>> Using cached_layers here works only by coincidence - if the >> >> >>> >>>>> desired >> >> >>> >>>>> layer is not manually checked out under be.sourcedir, it will >> >> >>> >>>>> not >> >> >>> >>>>> be found >> >> >>> >>>>> by cached_layers code, and will not appear here. >> >> >>> >>>> >> >> >>> >>>> >> >> >>> >>>> Ah, so would it be good to read from the database? Because I >> was >> >> >>> >>>> giving >> >> >>> >>>> full path of layers in the toasterconf.json file. I assume >> that >> >> >>> >>>> layer >> >> >>> >>>> information from the toasterconf.json file would be updated in >> >> >>> >>>> the >> >> >>> >>>> database? >> >> >>> >>> >> >> >>> >>> >> >> >>> >>> Would be inserted into the database as the file is read. >> >> >>> >>> >> >> >>> >>>>> >> >> >>> >>>>> >> >> >>> >>>>> I think a completely new piece of code is needed, which will >> >> >>> >>>>> track >> >> >>> >>>>> where any layer that has a HEAD branch is actually checked >> out. >> >> >>> >>>>> This path >> >> >>> >>>>> would be discovered and stored by importing a >> toasterconf.json >> >> >>> >>>>> file >> >> >>> >>>>> (the >> >> >>> >>>>> only place that can generate a HEAD branch), and verified to >> >> >>> >>>>> actually exist >> >> >>> >>>>> at build time in this function, getGitCloneDirectory(). This >> >> >>> >>>>> patch >> >> >>> >>>>> touches >> >> >>> >>>>> loadconf, but I think we might be able to get a better >> handling >> >> >>> >>>>> of >> >> >>> >>>>> that. >> >> >>> >>>>> >> >> >>> >>>>> >> >> >>> >>>>>> + if not url.endswith('.git'): >> >> >>> >>>>> >> >> >>> >>>>> >> >> >>> >>>>> I am not sure why the actual GIT url format is relevant for >> >> >>> >>>>> "HEAD" >> >> >>> >>>>> branches; we don't need to figure out where the layer would >> get >> >> >>> >>>>> checked out, >> >> >>> >>>>> but where it actually exists. >> >> >>> >>>>> >> >> >>> >>>>> >> >> >>> >>>>>> + from os.path import dirname >> >> >>> >>>>>> + extractDir = dirname(url) >> >> >>> >>>>>> + for key, val in cached_layers.iteritems(): >> >> >>> >>>>>> + if val == extractDir: >> >> >>> >>>>>> + local_checkout_path = key >> >> >>> >>>>>> + return cached_layers[local_checkout_path] >> >> >>> >>>>>> + else: >> >> >>> >>>>>> + local_checkout_path = cached_layers[url] >> >> >>> >>>>>> + return local_checkout_path >> >> >>> >>>>>> from os.path import dirname as DN >> >> >>> >>>>>> local_checkout_path = >> >> >>> >>>>>> DN(DN(DN(DN(DN(os.path.abspath(__file__)))))) >> >> >>> >>>>>> #logger.debug("localhostbecontroller: using HEAD >> >> >>> >>>>>> checkout >> >> >>> >>>>>> in >> >> >>> >>>>>> %s" % local_checkout_path) >> >> >>> >>>>>> @@ -245,7 +256,14 @@ class >> >> >>> >>>>>> LocalhostBEController(BuildEnvironmentController): >> >> >>> >>>>>> >> >> >>> >>>>>> # 3. checkout the repositories >> >> >>> >>>>>> for giturl, commit in gitrepos.keys(): >> >> >>> >>>>>> - localdirname = os.path.join(self.be.sourcedir, >> >> >>> >>>>>> self.getGitCloneDirectory(giturl, commit)) >> >> >>> >>>>>> + if not giturl.endswith('.git'): >> >> >>> >>>>>> + for key, val in cached_layers.iteritems(): >> >> >>> >>>>>> + if os.path.dirname(giturl) == val: >> >> >>> >>>>>> + tmpKey = key >> >> >>> >>>>>> + tmpVal = gitrepos[(giturl, commit)] >> >> >>> >>>>>> + gitrepos[(tmpKey, commit)] += tmpVal >> >> >>> >>>>>> + giturl = tmpKey >> >> >>> >>>>>> + localdirname = os.path.join(self.be.sourcedir, >> >> >>> >>>>>> self.getGitCloneDirectory(giturl, commit, cached_layers)) >> >> >>> >>>>>> logger.debug("localhostbecontroller: giturl >> %s:%s >> >> >>> >>>>>> checking out in current directory %s" % (giturl, commit, >> >> >>> >>>>>> localdirname)) >> >> >>> >>>>>> >> >> >>> >>>>>> # make sure our directory is a git repository >> >> >>> >>>>>> @@ -280,13 +298,36 @@ class >> >> >>> >>>>>> LocalhostBEController(BuildEnvironmentController): >> >> >>> >>>>>> >> >> >>> >>>>>> # verify our repositories >> >> >>> >>>>>> for name, dirpath in gitrepos[(giturl, >> commit)]: >> >> >>> >>>>>> - localdirpath = os.path.join(localdirname, >> >> >>> >>>>>> dirpath) >> >> >>> >>>>> >> >> >>> >>>>> >> >> >>> >>>>> I am not sure what this change tries to do; dirpath is >> actually >> >> >>> >>>>> a >> >> >>> >>>>> path >> >> >>> >>>>> in the git repo where the layer lives; it is not immediate >> that >> >> >>> >>>>> the >> >> >>> >>>>> all the >> >> >>> >>>>> layers live in the top directory of a git repo. This change >> >> >>> >>>>> invalidates the >> >> >>> >>>>> check below, where we verify that the layer path actually >> exists >> >> >>> >>>>> after >> >> >>> >>>>> checkout. >> >> >>> >>>>> >> >> >>> >>>>>> >> >> >>> >>>>>> + localdirpath = localdirname >> >> >>> >>>>>> >> >> >>> >>>>>> logger.debug("localhostbecontroller: >> >> >>> >>>>>> localdirpath >> >> >>> >>>>>> expected '%s'" % localdirpath) >> >> >>> >>>>>> if not os.path.exists(localdirpath): >> >> >>> >>>>>> raise BuildSetupException("Cannot find >> >> >>> >>>>>> layer >> >> >>> >>>>>> git >> >> >>> >>>>>> path '%s' in checked out repository '%s:%s'. Aborting." % >> >> >>> >>>>>> (localdirpath, >> >> >>> >>>>>> giturl, commit)) >> >> >>> >>>>>> >> >> >>> >>>>>> + layerlisturl, layerlistdir = "", "" >> >> >>> >>>>>> + layerlisturl = [localurl for localurl, >> >> >>> >>>>>> localpath >> >> >>> >>>>>> in >> >> >>> >>>>>> cached_layers.iteritems() if localpath == localdirpath] >> >> >>> >>>>> >> >> >>> >>>>> >> >> >>> >>>>> I suspect this logic will go away if we're not going to use >> >> >>> >>>>> cached_layers to discover the local checkout directories for >> >> >>> >>>>> HEAD >> >> >>> >>>>> urls. >> >> >>> >>>>> >> >> >>> >>>>> >> >> >>> >>>>>> >> >> >>> >>>>>> + if len(layerlisturl) != 0: >> >> >>> >>>>>> + layerlisturl = layerlisturl[0] >> >> >>> >>>>>> + if len(layerlisturl) == 0: >> >> >>> >>>>>> + if >> >> >>> >>>>>> os.path.basename(localdirpath).startswith("_"): >> >> >>> >>>>>> + layerlisturl = localdirpath >> >> >>> >>>>>> if name != "bitbake": >> >> >>> >>>>>> - >> layerlist.append(localdirpath.rstrip("/")) >> >> >>> >>>>>> + for gitlocal, localpath in >> >> >>> >>>>>> gitrepos.iteritems(): >> >> >>> >>>>>> + if layerlisturl in gitlocal: >> >> >>> >>>>>> + if len(localpath) > 2: >> >> >>> >>>>>> + for paths in localpath: >> >> >>> >>>>>> + if "bitbake" not in >> >> >>> >>>>>> paths[1]: >> >> >>> >>>>>> + layerlistdir = >> >> >>> >>>>>> localdirpath >> >> >>> >>>>>> +"/" + str(paths[1]) >> >> >>> >>>>>> + if layerlistdir not in >> >> >>> >>>>>> layerlist: >> >> >>> >>>>>> + >> >> >>> >>>>>> layerlist.append(layerlistdir.rstrip("/")) >> >> >>> >>>>>> + else: >> >> >>> >>>>>> + >> >> >>> >>>>>> layerlist.append(localdirpath.rstrip("/")) >> >> >>> >>>>>> + break >> >> >>> >>>>>> + if len(layerlist) == 0: >> >> >>> >>>>>> + for gitlocal, localpath in >> >> >>> >>>>>> gitrepos.iteritems(): >> >> >>> >>>>>> + for paths in localpath: >> >> >>> >>>>>> + if "bitbake" not in paths: >> >> >>> >>>>>> + >> >> >>> >>>>>> layerlist.append(layerlisturl + >> >> >>> >>>>>> "/" >> >> >>> >>>>>> + str(paths[1])) >> >> >>> >>>>>> + >> >> >>> >>>>>> >> >> >>> >>>>>> logger.debug("localhostbecontroller: current layer >> >> >>> >>>>>> list >> >> >>> >>>>>> %s " >> >> >>> >>>>>> % pformat(layerlist)) >> >> >>> >>>>>> >> >> >>> >>>>>> diff --git a/ >> >> >>> >>>>>> >> >> >>> >>>>>> >> bitbake/lib/toaster/bldcontrol/management/commands/loadconf.py >> >> >>> >>>>>> >> >> >>> >>>>>> >> b/bitbake/lib/toaster/bldcontrol/management/commands/loadconf.py >> >> >>> >>>>>> index 5022b59..a22f744 100644 >> >> >>> >>>>>> --- >> >> >>> >>>>>> >> >> >>> >>>>>> >> a/bitbake/lib/toaster/bldcontrol/management/commands/loadconf.py >> >> >>> >>>>>> +++ >> >> >>> >>>>>> >> >> >>> >>>>>> >> b/bitbake/lib/toaster/bldcontrol/management/commands/loadconf.py >> >> >>> >>>>>> @@ -45,12 +45,14 @@ class Command(BaseCommand): >> >> >>> >>>>>> for i in ['bitbake', 'releases', 'defaultrelease', >> >> >>> >>>>>> 'config', >> >> >>> >>>>>> 'layersources']: >> >> >>> >>>>>> assert i in data >> >> >>> >>>>>> >> >> >>> >>>>>> - def _read_git_url_from_local_repository(address): >> >> >>> >>>>>> + def _read_git_url_from_local_repository(address, >> path >> >> >>> >>>>>> = >> >> >>> >>>>>> None): >> >> >>> >>>>> >> >> >>> >>>>> >> >> >>> >>>>> If you want to pass in the path, please move the whole >> function >> >> >>> >>>>> outside >> >> >>> >>>>> _import_layer_config, as it's no longer a closure. >> >> >>> >>>>> >> >> >>> >>>>> >> >> >>> >>>>>> >> >> >>> >>>>>> url = None >> >> >>> >>>>>> + if not path: >> >> >>> >>>>>> + path = os.path.dirname(filepath) >> >> >>> >>>>>> # we detect the remote name at runtime >> >> >>> >>>>>> import subprocess >> >> >>> >>>>>> (remote, remote_name) = address.split(":", 1) >> >> >>> >>>>>> - cmd = subprocess.Popen("git remote -v", >> >> >>> >>>>>> shell=True, >> >> >>> >>>>>> cwd = >> >> >>> >>>>>> os.path.dirname(filepath), stdout=subprocess.PIPE, stderr = >> >> >>> >>>>>> subprocess.PIPE) >> >> >>> >>>>>> + cmd = subprocess.Popen("git remote -v", >> >> >>> >>>>>> shell=True, >> >> >>> >>>>>> cwd = >> >> >>> >>>>>> path, stdout=subprocess.PIPE, stderr = subprocess.PIPE) >> >> >>> >>>>>> (out,err) = cmd.communicate() >> >> >>> >>>>>> if cmd.returncode != 0: >> >> >>> >>>>>> logging.warning("Error while importing >> layer >> >> >>> >>>>>> vcs_url: >> >> >>> >>>>>> git error: %s" % err) >> >> >>> >>>>>> @@ -121,7 +123,11 @@ class Command(BaseCommand): >> >> >>> >>>>>> logger.error("Local layer path %s >> must >> >> >>> >>>>>> exists. Are you trying to import a layer that does not >> exist ? >> >> >>> >>>>>> Check your >> >> >>> >>>>>> local toasterconf.json" % lo.local_path) >> >> >>> >>>>>> >> >> >>> >>>>>> if >> >> >>> >>>>>> layerinfo['vcs_url'].startswith("remote:"): >> >> >>> >>>>>> - lo.vcs_url = >> >> >>> >>>>>> _read_git_url_from_local_repository(layerinfo['vcs_url']) >> >> >>> >>>>>> + if layerinfo['local_path'] not in >> >> >>> >>>>>> ["meta", >> >> >>> >>>>>> "meta-yocto", "meta-yocto-bsp"]: >> >> >>> >>>>> >> >> >>> >>>>> >> >> >>> >>>>> Please don't use hardcoded layer names anywhere in the code. >> >> >>> >>>>> >> >> >>> >>>>> We do not want special handling for some layers, all layers >> need >> >> >>> >>>>> to >> >> >>> >>>>> be >> >> >>> >>>>> treated in the same, uniform, way. >> >> >>> >>>>> >> >> >>> >>>>> >> >> >>> >>>>>> + repo_path = >> >> >>> >>>>>> layerinfo['local_path'] >> >> >>> >>>>>> + else: >> >> >>> >>>>>> + repo_path = None >> >> >>> >>>>>> + lo.vcs_url = >> >> >>> >>>>>> _read_git_url_from_local_repository(layerinfo['vcs_url'], >> >> >>> >>>>>> repo_path) >> >> >>> >>>>> >> >> >>> >>>>> >> >> >>> >>>>> I think this code needs >> >> >>> >>>>> >> >> >>> >>>>> >> >> >>> >>>>>> >> >> >>> >>>>>> if lo.vcs_url is None: >> >> >>> >>>>>> logger.error("The toaster >> config >> >> >>> >>>>>> file >> >> >>> >>>>>> references the local git repo, but Toaster cannot detect >> >> >>> >>>>>> it.\nYour >> >> >>> >>>>>> local >> >> >>> >>>>>> configuration for layer %s is invalid. Make sure that the >> >> >>> >>>>>> toasterconf.json >> >> >>> >>>>>> file is correct." % layerinfo['name']) >> >> >>> >>>> >> >> >>> >>>> >> >> >>> >>>> A bit more explanation would help me move further to improvise >> >> >>> >>>> the >> >> >>> >>>> patch. If you don't mind please? So if I understand correctly >> a >> >> >>> >>>> separate >> >> >>> >>>> function should be there to handle HEAD branches provided by >> >> >>> >>>> toasterconf.json file, right? >> >> >>> >>> >> >> >>> >>> >> >> >>> >>> >> >> >>> >>> Yep, exactly my point. >> >> >>> >>> >> >> >>> >>> When inserting the Layer_Version objects for the "HEAD" branch, >> >> >>> >>> the >> >> >>> >>> Layer_Version.local_path should >> >> >>> >>> >> >> >>> >>> be set to the layer path. >> >> >>> >>> >> >> >>> >>> When checking out the layers in localhost bbcontroller, the >> >> >>> >>> checkout >> >> >>> >>> should be skipped at all times for "HEAD" branches; instead, >> the >> >> >>> >>> value in >> >> >>> >>> Layer_Version.local_path should be used. >> >> >>> >> >> >> >>> >> >> >> >>> >> >> >> >>> >> Is there a way to access local_path of toasterconf.json file >> from >> >> >>> >> localhostbecontroller.py file? >> >> >>> > >> >> >>> > I got the solution. I have modified local_path from "/" to the >> value >> >> >>> > in >> >> >>> > the >> >> >>> > configuration file in the database. >> >> >>> > >> >> >>> > >> >> >>> >> >> >> >>> >> >> >> >>> >>> >> >> >>> >>> >> >> >>> >>> >> >> >>> >>>>>> >> >> >>> >>>>>> >> >> >>> >>>>>> -- >> >> >>> >>>>>> 1.9.1 >> >> >>> >>>>>> >> >> >>> >>>>>> -- >> >> >>> >>>>>> _______________________________________________ >> >> >>> >>>>>> toaster mailing list >> >> >>> >>>>>> [email protected] >> >> >>> >>>>>> https://lists.yoctoproject.org/listinfo/toaster >> >> >>> >>>>> >> >> >>> >>>>> >> >> >>> >>>>> >> >> >>> >>>>> >> >> >>> >>>>> -- >> >> >>> >>>>> Alex Damian >> >> >>> >>>>> Yocto Project >> >> >>> >>>>> SSG / OTC >> >> >>> >>>> >> >> >>> >>>> >> >> >>> >>>> >> >> >>> >>>> >> >> >>> >>>> -- >> >> >>> >>>> സുജിത് ഹരിദാസന് >> >> >>> >>>> Bangalore >> >> >>> >>>> <Project>Contributor to KDE project >> >> >>> >>>> http://fci.wikia.com/wiki/Anti-DRM-Campaign >> >> >>> >>>> <Blog> http://sujithh.info >> >> >>> >>> >> >> >>> >>> >> >> >>> >>> >> >> >>> >>> >> >> >>> >>> -- >> >> >>> >>> Alex Damian >> >> >>> >>> Yocto Project >> >> >>> >>> SSG / OTC >> >> >>> >> >> >> >>> >> >> >> >>> >> >> >> >>> >> >> >> >>> >> -- >> >> >>> >> സുജിത് ഹരിദാസന് >> >> >>> >> Bangalore >> >> >>> >> <Project>Contributor to KDE project >> >> >>> >> http://fci.wikia.com/wiki/Anti-DRM-Campaign >> >> >>> >> <Blog> http://sujithh.info >> >> >>> > >> >> >>> > >> >> >>> > -- >> >> >>> > _______________________________________________ >> >> >>> > toaster mailing list >> >> >>> > [email protected] >> >> >>> > https://lists.yoctoproject.org/listinfo/toaster >> >> >>> > >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> -- >> >> >> സുജിത് ഹരിദാസന് >> >> >> Bangalore >> >> >> <Project>Contributor to KDE project >> >> >> http://fci.wikia.com/wiki/Anti-DRM-Campaign >> >> >> <Blog> http://sujithh.info >> >> > >> >> > >> >> > >> >> > >> >> > -- >> >> > സുജിത് ഹരിദാസന് >> >> > Bangalore >> >> > <Project>Contributor to KDE project >> >> > http://fci.wikia.com/wiki/Anti-DRM-Campaign >> >> > <Blog> http://sujithh.info >> > >> > >> > >> > >> > -- >> > സുജിത് ഹരിദാസന് >> > Bangalore >> > <Project>Contributor to KDE project >> > http://fci.wikia.com/wiki/Anti-DRM-Campaign >> > <Blog> http://sujithh.info >> > > > > -- > സുജിത് ഹരിദാസന് > Bangalore > <Project>Contributor to KDE project > http://fci.wikia.com/wiki/Anti-DRM-Campaign > <Blog> http://sujithh.info > -- സുജിത് ഹരിദാസന് Bangalore <Project>Contributor to KDE project http://fci.wikia.com/wiki/Anti-DRM-Campaign <Blog> http://sujithh.info
-- _______________________________________________ toaster mailing list [email protected] https://lists.yoctoproject.org/listinfo/toaster
