Posts Tagged ‘project-builder.org’

It starts as a happy new year indeed

2014/01/04

Well, would you really be surprised if i say that the begining of 2014 looks as promising (and as busy of course) as the end of 2013 was ?

While travelling to Linux.conf.au in Perth (28 hours door to door but could it be a better start for 2014 !) I had some time to look at Project-Builder.org, subject of my conference on Monday and also to MondoRescue.

For Project-Builder.org, I’ll publish a new version for LCA (0.12.3) which will fix rpmbootstrap for lastest Fedora (18-20), Mageia 3 and also other recent distros. Also as SVK is now broken on Mageia 3, I’m using git-svn to work on my laptop when remote, and thus pb supports it now. Some various fixes since last year release will also be done (better printing with VM/VE name for logs, improved ntp support, pbdistrogetparam command to easy shell interface…), but globally the software is pretty stable for my usage, so now it’s your turn to tell me what would be useful for you in it. I also need to make a newer presentation for Monday with a short demo.

For MondoRescue I’m not ready yet to publish a final version, so I have made for now a first beta for the 3.2.0 version. First this will be a new 3;x version as there are lots of changes in the code that may make it less reliable due to the adoption of dynamic memory allocation instead of static in a lot of functions. If I compare 3.0 and 3.2:

  • 3.0
    • total mr_asprintf usage : 646
    • total sprintf usage : 674
    • total strcpy usage : 560
    • total fgets usage : 79
    • total malloc_string usage : 367
    • total MAX_STR_LEN usage : 370
  • 3.2
    • total mr_asprintf usage : 1223
    • total sprintf usage : 166
    • total strcpy usage : 388
    • total fgets usage : 28
    • total malloc_string usage : 129
    • total MAX_STR_LEN usage : 221

Which means that a lot has been done in code changes between 3.0 and 3.2. But also a lot remains to do if we want to have no malloc_string nor MAX_STR_LEN at all. And also if I made mistakes in the mr_malloc/mr_asprintf/mr_free usage, the commands will crash. THat’s why I need your tests here ! I’ve made a full bakup restore cycle (which has revealed some issues that I fixed), but I’m far from being confident in the result.

Another consequence is that this version will probably have less fixes than previous ones as most of the time has been passed on code modernization.

And it will require new mindi and mindi-busybox versions. And these versions should finally work for systemd crazyness of removing /bin and /sbin (which broke MondoRescue for a too long time now). And you’ll need new perl modules in order to have it work correctly as I finally rewrote some bash mindi functions into perl to have what I consider better code.
Which means Fedora 18-20, Mageia 3 should work out of the box (at least my Mageia 3 now works correctly).

And expect again more pacthes to MondoRescue durnig the 28+ hours back home at the end of next week 😉

So I wish to all readers a happy new year 2014 and hope it will start for you as it has for me !

Advertisements

Meeting at Linux.conf.au in Perth

2013/12/21

I’m again lucky to be able to fly in a plane for 20+ hours the first week of January to attend Linux.conf.au ! (And of course the 20+ hours of fly back ;-))

I’ll talk on Monday 06 January 2014 during the miniconf dedicated to Developer, Testing, Release and Continuous integration Automation of project-builder.org and the idea of Continuous packaging.

This has been possible only thanks to HP‘s support, its Open Source investment council, and the kindness of our VP & Deputy General Counsel, Cloud Computing and Open Source Eileen Evans who continues to support my travels at many Open Source conferences, and should be greatly thanked for that.

I’ll make a new version of the tool available to celebrate this, not that a lot has changed, but some fixes should be made available as packages, and it’s a long time since I published the last one. In fact, for me the tool is pretty stable and usable. I recently added git-svn support, as svk is broken with latest perl versions such as on my Mageia 3 😦 So learning slowly git, and still not liking it that much, but I have not a lot of other choices.

I still need to improve rpmbootstrap for the latest Fedora which changed their mirroring structure. Hopefully this will be done on time.

And as I’m on it, Merry Christmas and Happy New Year to you all readers !

Distro Recipes 2013: Nice first !

2013/04/09

Distro Recipes 2013
As indicated, I had the opportunity to talk during the first Distro Recipes event organized in Paris last week, at the invitation of Hupstream. As Yoann Sculo posted, this was a very interesting day for me, and I really regret I was busy to also attend the first day and the opening.

After a nice welcome breakfast, Aurélien Bompard started by presenting the Fedora distribution.
Aurélien Bompard presenting the Fedora distribution
He did a great job especially expalining how easy it was to become a Fedora maintainer, even if a comparison to Debian revealed that it’s much less different that what people may think (it also takes time to become a packager able to modify most distro packages) and I know by experience that the Fedora packagers are really picky (sometimes for not so good reasons) with new contributions.

After that I talked about HP and Linux distributions. I used in fact the standard HP marketing presentation of the company as a starter (modified of course to suit my needs and include more penguins !) in order to explain the span of our activities, our relationship with communities including distributions, announced that HP will even soon provide firmware for ProLiant servers under a package format (rpm and deb), the fact that HP doesn’t see Linux demand for desktop/laptop on the consumer market (no, it’s not just a price issue that would make Linux more appealing in that case as I justified) but that we do support Linux on some enterprise desktops/laptops. Hopefully this was useful and/or new to some of the audience.

Then Dodji Seketeli made the type of talk making you believe that you could contribute to gcc ! Of course, when he details how much time it took him to add some of the features of the next stable version, you know you can’t ! Well I at least 😉 Anyway lots of good news and features that make that future version 4.8 expected soon.
Dodji Seketeli on gcc

That conclude our morning sessions, and it was then time to eat !! Especially as we had a great buffet waiting for us as you can see:
Repas midi

In order to avoid a sleepy afternoon, we started right after by a round table with 7 people (!), that I had the pleasure to chair. With a representative of each distribution (Mageia, openSUSE, Fedora, Debian, Arch, Embedded) and a Microsoft representative, you could expect blood and swords fight ! Not at all, I was surprisingly happy that the elements were clearly exposed, each representative defending their own work rather than criticizing, and finding ways to propose more future joint work. Of course, some subjects such as LSB/FHS lead to more debate, but very constructive and I really enjoyed this time slot as a way to show that differences are an added value ! It was also the opportunity for me to meet with Colin Guthrie and Frédérc Crozat, which I had never met before. These distros should be happy to have such representatives defending them (and the others too of course ;-)) Finally if you have ideas to share to improve cross-distribution work , consider joining the mailing listdedicated to his topic and start sharing your ideas.

Then it was time again for the remaining presentations. The first was Lucas Nussbaum. Long time Debian Developer, (he is even running for the Debian Project Leader now, vote for him !) he made a convincing picture of the Debian ecosystem, the numerous Web sites that contributors can create to enhance the distribution with stats, infos, Ubuntu correlations, … As usual, Debian appears as a very mature distribution, with a strong Governance, being perl friendly… If I had to change I may well become a debianers. But isn’t it because of the pres, as the morning I was a fedorian 😉
Lucas Nussbaum pour Debian

The next speaker was a long time Linux enthousiast Pierre Ficheux. In fact back when it was Minitel time (not 2.0) I used his xtel program !! Pierre made a presentation (in english but with the accent ;-)) around embedded Linux distributions, presenting various way to tailor one for your device (he was using a Raspberry Pi) depending whether you use an Ubuntu, a Yocto generated one or a pure OpenEmbedded linux one. Definitely a good idea to explore for my Pi !
Pierre Ficheux sur Yocto (Open Wide)

And then we had the lightnings talks. Aurélien Bompard was there again for HyperKitty. Too bad it’s devoted to mailan, as I think Sympa would also benefit from such a work, as their archive management (at least on the latest versions I used) could be improved.
Aurélien Bompard pour HyperKitty

I came then again on stage for a project-builder.org presentation (building cross-distro packages for upstream projects) and made a short demo which I think is explaining much more than my slides, so I plan on using it more in the future !

After me, Eric Leblond explained how his upstream project (ulogd2) wasn’t picked up correclty by most distributions and asked for help to improce that.

And final speaker was Nicolas Vérité who made a panel on all mobile Linux distributions, recommending to follow closely Tizen for the future as the main force in this area.
Nicolas Vérité sur Distros Mobile

Too bad it was already over. Anne closed the session and I’d like to thank her for the invitation and the perfect organization of this first cross-distributions vent as a real success. Well done and see you next year hopefully !
Anne Nicolas (Hupstream)

Meeting at the first Distro Recipes

2013/03/19

I’ve been kindly invited for the first Distro Recipes event in Paris the 4th and 5th of April.

As I have an internal HP meeting on the 4th, I’ll be only available at the end of that day, but will present on the 5th how Hardware manufacturers work with Linux distributions, giving the example of HP. I’ll also monitor a round table aound “Linux distributions: differences and commonalities” where we will try to have polite discussions 😉 about what makes a distribution unique, and what is instead worth sharing by collaborating. Finally I’ll also present during the lightning talks “Project-Builder.org: packaging for multi-OS Open Source Projects

So won’t have that too much time outside of presentations, as you can see, but would be happy anyway to meet with MondoRescue or Project-Builder.org or HP/Linux users and talk with them.

Anyway a great event to be in, as the list of speakers is really interesting, all majors distros being represented, and for sure very interesting new contacts to make, and hopefully the curiosity to discover these other distros that you don’t use 🙂 Come for the same reasons, and see you there !

MondoRescue 3.0.3 is finally out

2013/03/17

I know. It’s been a long process. And I’m not even fully satisfied with the results, as we do have unresolved bugs in this version. But as it also fixes some critical others that were expecting for a long time (3+ months), I didn’t want to delay more the release of this version.

So here it is. mondo 3.0.3, mindi 2.1.4 and mindi-busybox 1.18.5-3 are now availble from the master ftp server. And as given in the announce, most of the distributions (nearly 100 of them) also have packages ready for use. Once more couldn’t do it without project-builder.org 🙂

The detailed change logs are available for mindi, mindi-busybox and mondo.

Among the main fixes brought by this version, a much better support of SLES 10, SLES 11 SP1, SLES11 SP2, especially for LVM and device exclusion, grub, keyboard.

I also received very, very valuable contributions from users, which helps producing a better version of course, and reduce the time of the resolution of the problem in the upstream version. Thanks again for helping ! Including on some very old bugs. And Victor being one of the most prolific.

There are even some new features such as the support of swaplabel or the inclusion of all tools part of minimal.conf now in the first boot part.

As said earlier, some bugs ar not fixed yet. I passed most of the week trying to fix the automatic mode where CTRL-ALT-DEL doesn’t work. I added support in 3.0.3 of an inittab file, but whatever the conf I use fo now, it doesn’t trigger a reboot when using the magic key or sending it from the KVM monitor. So be warned and use with care. I’ll report on the busybox ML as I still have the issue with 1.20.2, and try to get help from this community. Could well trigger the release of a new mindi-busybox (and maybe mindi) soon after this one.

In the serie of un-fixed bugs for lack of time for this time are some that a user reported as more important to fix soon:

  • Ticket #628: 3.0.2-1 Fail to Restore from External Hard Disk – This is a very big issue here.
  • Ticket #641: Specifying the Same Backup to NFS via CLI=Success via GUI=Fail – Although it is possible to work around this problem it is preventing the creation of exceptional backups by users with little knowledge of Mondo. A fix will be most welcome and will present a more appropriate impression of Mondo.
  • Ticket #640: mondo.tmp.xxxxx & mondo.scratch.xxxxx Issues – This is not a critical issue. A fix will help with backup management and housekeeping tasks.

I globally agree these are also important to fix (even if less than Ticket 627). I also think we need to work on Ticket 656 as well. I’d like to get your comments as well in order to prioritize the fixes in the next version, as I can’t work full time on MondoRescue, so need to choose where to put my efforts.

Finally time to publish pb 0.12.2

2013/03/01

As you can see with the few messages I had time to post on this blog, the end of 2012 start of 2013 has been pretty busy, and I’m late in delivering the 2 projects I’m leading. So this week, I decided it was time to make a 0.12.2 version of pb, and make it available. Was asked by my colleagues of FOSSology, specially to add Fedora 18 support, so I also build my VMs to make packages on this distro.

BTW, a bit of ranting for Fedora once more: no perl by default :-(, and no ifconfig nor route command either which is breaking MondoRescue of course, and I guess tons of other software around. These guys don’t care about past, but don’t provide compatibility tools either !! So I’ll have to make new patches, just to do the same as what was done, but with another command again. Not to speak of systemd which I still have issues to deal with 😦 That doesn’t make stuff go faster !

Anyway, the version is now out, no official bugs fixed, but a lot of small stuff here and there which were desrving a release. No time to test Fedora 17/18 VE yet, so you’ll have to do that yourself if you want. I also had a look at virsh usage in combination with pb, and it’s again not as easy as it could seem to be. Especially port redirection I’m easily using by launching qemu-kvm manually with the -redir or hostfwd option doesn’t seem to be possible with the user mode network through virsh (neither manager nor CLI). Will have to post on their ML to see how they do that, if they can !

And MondoRescue has been very late. I really need to publish a verion, but I still have some blocking bugs I really would like to get rid of: CTRL+ALT+DEL not working anymore during restore, some LVM issues on RHEL, some grub issues on SLES… Hopefully at the end of next week I’ll have made progresses.

Of course patches are much easy to integrate, but I receive more bug reports than them 😉

And also back to preparing the HP internal TES event, Solutions Linux confs, submitting to LinuxCon, working on an FLOSS ITIL stack, learning more OpenStack, looking at Intel’s TXT…. so many things I’d like to do or learn and will never have time to ! Maybe at least I’ll talk about that another time.

Last 2 weeks too hot…

2012/07/07

Had lots to do during the last weeks. New MondoRescue Version, new project-builder.org version, Solutions Linux event in Paris, new HP internal projects, and on the private side rehearsal + concert and vocal ensemble conducting, finding a room for my daughter next year in Paris for her studies was a bit too much, with not enough sleep.

Was completely tired last thursday, with 39°+, and slept most of Friday as a consequence. Saturday, I still had not completeley recover, Not a real serious burn out, but made me think I was probably in need of rebalancing a bit stuff to avoid a serious one. And it took me nearly a week to recover, even if I dstill don’t feel exactly as before.

So I’ve just restarted this week to work on some mindi patches, and even if I planned to release a new version of mindi during the week-end it will now be during this !

I’ll be on vacation next week, for my yearly renaissance music week near Paris. So if you want to meet, for once, it will be at one of the concert we will perform the 13th, 14th or 15th of July as explained in the link ! Hopefully that change of activity will let me rest a bit a come back stronger 🙂

Project-Builder.org 0.12.1 is now available

2012/05/30

As promised (or threatened (c) Bryan !) I have now published a new main version of project-builder.org, the 0.12.1 !

Since my previous post, I worked a lot on it to make it available in fact, and it took finally just a bit more than a year ! But it was hopefully worth the wait 😉

In order to ease the publication, I started to write a script to make project-builder.org tests in an automatic fashion. It helped me to find lots of small or less small remain issues before the release, so I’m more confident than before that this version is a good one indeed ! This was especially needed due to the fact I received this time other contributions.

Indeed, I received great contributions from Eric Anderson but I had to revert some of them, as the project wasn’t completely ready to deal with it. the major one being to error out immediately. That broke in fact a certain number of use case, where errors should be tolerated, and even after trying to catch them, I was unsuccessful in some case, so made a new parameter in the configuration file for that. So you can benefit from Eric’s work by activating pbstoponerr (and also pbshowsudo if you want to see what pb does behind the scene with sudo commands) in the /etc/pb/pb.conf configuration file. default is to have both of them off for now. It may change in the future, when the code handles more efficiently all error cases.

Also what I missed to detail last time is the new version number. This version is not compatible with the previous one, so you’ll have to update your VEs/VMs/RMs in order to benefit from it. Especially for test versions, now we use the full version name for producing the tar files, and the old version won’t build packages in the build environment when called from a 0.12.x external pb.

In order to do that, just use pb -p myproject setupvm (or setupve, setuprm) to update all your VMs in a row.

Project is still available at ftp://ftp.project-builder.org/ and you’ll find there all the versions made for all the distributions tuples supported (120+ as of today). Use trac to report problems or enhancement requests for next version, that I promised will not be next year but earlier !!

Enjoy and feel free to join our mailing-list to discuss more about it.

About to publish project-builder.org 0.12.1

2012/05/22

When I looked at the date of the current project-builder.org current stable version, I had a shock ! It has been nearly a year since I published that version. I should not stay that long without providing updates 😦 But you know what it is, you always think that you should still add that latest cool feature, and then that other, + fix this problem, … and you end up one year later with a great development version, but still no public stable one so others could benefit from your work.

So it’s time ! Especially as I have committed a lot of patches from an HP colleague, Eric Anderson, who is using the tool (and in its devel version !) to support packaging projects he is working on for HP. So I worked hard since the 8th of May to integrate what he has made available on github, since he got HP’s approval through the OSRB. And I have integrated I think more than 90% of his enhancements, which now will make 0.12.1 even more appealing than before.

But I’m not as a good guy as some think 😉 Some of the patches seemed strange to me, or could have an impact which I wasn’t completely sure of, so there is still some work Eric did, that has been left appart for the moment. Sorry for that, but I’m a slow guy, using this project on a daily basis, so I really need to be convinced before accepting a patch. But I was convinced by a lot 😉 I’ll now contact him back through the project mailing list, and see how we can work on these remaining points for 0.12.2 so he has a tool working much better for him. Among the nice stuff Eric has brought is clearly a much improved GIT support (read working !), and Debian/Ubuntu support as well (as he is using them natively). He also added support for stopping with the first error, or not as this is an option. Plus lots of improvements all around.

And he will also beneft from my own modifications, which hopefully improved the tool as well ! The last one, being with the configuration file management, now fully done in memory, instead of re-reading all conf file each time (which could also have some advantages, but speed improvement is what I was looking for here). In particular, in this version, the documentation has been improved a lot and should help more beginners. I have added a new getconf option to help following the value of configuration items (useful as pb uses lots of config files !), checkssh to verify what has been delivered on the repository, wrt what should have been, cleanssh to clean up the remote repository for test versions. A new -t option has been added to create local packages more quickly (when only the local distro will be used). Patches support has also been extended to .deb distributions. I have also introduced a new script, pbmkbm, which is aimed at creating customized boot media (project-builder.org make boot media), that will be the basis of an evolution of mindi in the MondoRescue project (doesn’t work as of now, and more on that later on). Some enhancement requests and bug fixes have also been done (#99, #585, #93, #522, #103, #105, new distro support for Fedora 15 and 16, Ubuntu 11.10, 12.04, OpenSuSE 11.4, 12.1 at least). #101 is the last on the list for 0.12.1 and as soon as it’s mostly done, I’ll publish it. Promised !

Stay tuned as usual 😉

UUWL aka the Unix to Unix Wrapper LIbrary is now available

2012/05/16

I recently receive the approval from the HP OpenSource Review Board so that we can publish a new HP and Intel sponsored Open Source project called the UUWL aka the Unix to Unix Wrapper Library, now available at UUWL.project-builder.org.

The published code is a first version providing help to migrate C code from Solaris to Linux. That’s a first step in this project. The target is to augment that with more code porting helper functions, which have not yet being developed, and also to target next other Unices such as AIX. As well we think this library may well become a must have for Linux distributions, so they may integrate it as they do with the GNU LibC, so that Linux could become the most porting friendly platform.

For the moment, only the source code and build process is available. I’ve started to work on the packaging with project-builder.org, and soon multiple packages will be available for various Linux distributions in order to ease installation and usage. We also need to release more documentation, use autoconf/automake, … It’s just a start. But as such we thought it would be worth sharing and try to build a new community interested by this topic.

We are interested by getting first feedback around this project. And if you have porting experience, you’re also welcome to join and share it with us so we could improve the UUWL and make it more useful for everybody. It’s released under a dual license, both OSI approved, the LGPLv2 and the MIT license, so it could be used in multiple context.