Posts Tagged ‘project-builder.org’

Still working on MondoRescue 3.2 to make it available ASAP

2014/03/14

Even if stuff do not progrees at the speed I’d like them to progress (lots of travels on HP side since early 2014 and 4 concerts to perform on the private side) I’ve tried to improve the 3.2 version I published unofficially as beta. Interestingly enough, even when I do not announce that packages are delivered, there are people who do use them !!! Which gave me some feedback (you can guess it wasn’t that positive), so in fact it’s already my second delivery :-) and it contains some interesting new features:

  • mindi now uses the new mr-kernel-get-modules perl script which allows now in mindi to just mention end modules names andd not dependencies anymore, which are now computed by the script !! This will help a lot to maintain the list of modules, which was always impacted by low-level dependencies changes at kernel level.
  • Support of symlinks for newest distributions based on systemd such as Fedora, Mageia, … is now finally working !! Again this was done exporting the existing wrong code into a separate perl script which now operates correclty. This is part of the global willingness to recode most of mindi and some of mondo in perl. This took quite a long time, as of course, we need to stay compatible (a word systemd team doesn’t care about of course) with other tools, and older distributions. Side note, this is probably one of the reason MondoRescue is still appreciated by its community :-)
  • The introduction of a dependency on a perl function was incorrect and people trying to install from packages gave feedback that they had errors dof course ue to that. This is now fixed, as project-builder.org indeed had an issue because a low level function was depending on a higher level function not part of the perl modules provided for MondoRescue. With 0.12.5 of project-builder.org this is completely solved.
  • Now I still have regressions with the isolinux menus, NFS on Mageia 4 and systemd not working anymore (change of network NIC name is the root cause). However the ldlinux.c32 issue for syslinux > 5.x is now solved.

Next week is the TES, so won’t have much time to work on it. Expect news the week after.

project-builder.org 0.12.5 is now available

2014/02/07

Finally, after having published the version 0.12.3 on time for Linux.conf.au, I found some remaining bugs in it (problem of time based realease and not enough time to test), then I made a 0.12.4 version soon after as promised to solve these, but still missed some aspects, and those are now solved with this 0.12.5 version.

So this version fixes an issue with messages printed which were done in double, and also the way we manage naming of Debian versions, following the recent change for Debian 7 (using now only the major version, and not mentioning the minor version which is now useless).

I also fixed a dependency issue, seen when trying to install the beta of MondoRescue, where a function wasn’t provided in the perl-ProjectBuilder module, while used in the code :-( This is now solved, and I’ll now start working on the next MondoRescue beta which should now be installable with yum/apt-get/urpmi.

This project-builder.org version should now be stable to use for some weeks, as I do not plan to make big changes in it, as this is perfectly fitting my needs now. Of course, more could always been done, but I can’t advance on all sides at the same time, so now it’s MondoRescue‘s turn !

Enjoy !

Random thoughts after 3 days down under and 1 around Linux.conf.au

2014/01/07

Australia !
Back to Australia !
Shark Bay
Just after my arrival in Perth last Friday, I had a bit of time to walk in the city in order to have a view on it and feel the atmosphere.
View from the hotel
It’s an interesting mix of modern buildings and a bit less modern buildings !
Mix of buildings
Of course, Australia is a young country, with (from my point of view) mostly young people around (that’s where I see I’m getting old !). People are very nice, friendly and always ready to help with a smile. It’s my third time here, and it’s always been like that, that’s probably why I like coming back here.
Australian Steak
I had a dinner in what I found a strange place, the shed, where I had to show my ID before entering, which was pretty empty despite the size. Maybe because it was a bit early. The dinner was good, but I really felt alone !
That's where Perth performs savant music

It was then time to go back to the hotel for some mail, and the preparation of my Monday presentation.

Being in Australia during europe winter time is just great. As great that you can receive too much sun on your head ;-) Especially when you go to such a nice place as Fremantle !
Main Fremantle Street
I did that on Saturday (for once I had time around an event) in that city which is similar to a french mediteranean city like Cagnes sur mer e.g. (more from a climate perspective than an architectural one)
Hall Town
and so I passed the full day around, enjoying the view on the Indian Ocean (my first time),
Site seeing from Round House
and beach (nearly empty as very windy)
Fremantle beach
and the nice food you can eat on the harbour
View on the harbour
(remember that as french we put a lot of emphasis on this, and even more because it’s me ;-))
Lunch

One of the main building of Fremantle is their prison, which has been added to the World Heritage List of Unesco as a testimony of the role of convicts/prisoners sent to Australia to work there. One of the oldest building of the region, even if it’s just less than 200 years (old european reaction ;-))
Fremantle prison

It’ was also interesting to see that Fremantle uses Wikipedia to document their sites. They are adding QRCodes pointing to Wikipedia pages in order to make your visit more rich. That’s the first time I see that usage BTW.
Wikipedia QR code

Sunday was passed doing more preparation around project-builder.org release 0.12.3 and the presentation. I just took some time in the afternoon to go back in the city
Skyline view some strange trees in parks
Tree
and bells tower
Bells tower
before recognizing the itinerary to go to Linux.conf.au
LCA2014 Banner
hosted at the University of Western Australia
UWA
where we could register.
UWA main building
Despite not being at LCA for the first time, I attended Rusty Nelsson session on first timer LCA attendees, which was a nice way to start the event.First time session
After some more discussion at a nearby bar, it was time to finalize my presentation, and work on the demo. Took me up to 3AM, but was still not finished as I wanted !

On monday, LCA was starting.
Start of LCA
The first keynote was about Whistle-blowing (les lanceurs d’alerte for my french audience who like me would not happen to know what it is) and how their perception is changing in our post-Snowden era.
Dr Suelette Dreyfus
That was an interesting presentation of her finding through a survey they organized to gather data. Especially after having seen the keynote at LinuxCon EMEA around Living in a Surveillance State by Mikko Hypponen, which I highly recommend to watch,as it’s a very enlightning one.
Dr Suelette Dreyfus
However, during the Q&A session, I found a bit strange that the audience didn’t want to listen to the question from a doctor around how to determine what is good and what is bad, which was much more interesting that what they felt it could be. And I think he was right, as this is a real concern that should rather be dealt with, instead of just asking the person to shut up. The limit of what can be disclosed or not whether you are in a government or a private company wrt ethic aspects is really a difficult topic to solve and more debate should be left so more interesting input could be heard and answers brought to improve the quality of the debate.

And also it’s interesting that the spot is now only on the NSA, whereas we tend to forget that some months ago, we had the same questions around Facebook. Of course, people give willingly their info to Facebook while theydon’t to the NSA, and that’s a bad thing. However, it doesn’t rmove the other threat from companies like Facebook which should continue to be explained to all IT users and consumers.

There was a remark on the fact that US own 5 millions records of autralian citizens who have travelled to the US. Again, it’s easy to avoid that: do not travel to the US. If you want to go there, it seems normal to me they can ask for info beofre to protect themselves. Of course, the level of what is asked should be reasonable wrt the effect researched, and people have modification right son it and insurance it won’t be provided to other entities. But here I think they are in their own right to gather them. Of course, again nothing to do with what we’re learning regularly thanks to E. Snowden revelations with what the NSA is doing.

I passed the rest of the day mostly in the Continuous Integration miniconf which was also hosting my talk with the exception of a presentation around ansible and vagrant I wanted to follow in the sysadmin mini-conf. It turned out that this presentation wasn’t so interesting due to the lack of demo (no network). Too bad as I’m also testing ansible as time permits on my side and would have like to get insights.

So after that I took some time to finish my slidset for the pres of the afternoon and the demo I wanted to make. I think I’ll never been able to finish a presentation days in advance completely. Don’t get me wrong, I have plenty of material availblle and I can make any 3 days workshop on the fly just using what I already have. However, I like to tailor the presentation to the audience, the context, polish one or two stuff, remove slides and some new ones… And same with the demo. So even if I started early before coming, I just finished to publish project-builder.org 0.12.3 the morning (time for all packages to build), realized that some feature that I hadn’t tested enough were not working, so making just a last patch (c) to have my demo shiny !

So I missed some sessions in between and went back to the CI miniconf and really heard Anita Kuno’s talk on 3rd party testing with OpenStack (a good one on latest aspects of the project I wasn’t aware of – this one is moving soooo fast !).
Geology Building at UWA

And finally all went well (at least from my point of view of course, ask one of the around 40 people of the the audience for objective feedback !). Demo worked as expected (thanks for preparation ;-)) and as usual I din’t had enough time to cover all what I wanted to address. Will see now if my Continuous Packaging approach is supported more in Australia, and if project-builder.org gets adopted there to create more upstream packages for some projects. Those interested can find my presentation on SlideShare. The video is also available.
Perth Lighted building
End of day was dedicated to the CI BoF and a dinner with a lot of HP peers working on OpenStack on various aspects (always amazed to meet so many people involved in it as time passes that I wasn’t knowing before).

But that’s not the end ! More “awesome” presentations to see the days coming. And more pictures are available at https://plus.google.com/photos/112434061686721373729/albums/5966194867275136465

It starts as a happy new year indeed

2014/01/04

Well, would you really be surprised if i say that the begining of 2014 looks as promising (and as busy of course) as the end of 2013 was ?

While travelling to Linux.conf.au in Perth (28 hours door to door but could it be a better start for 2014 !) I had some time to look at Project-Builder.org, subject of my conference on Monday and also to MondoRescue.

For Project-Builder.org, I’ll publish a new version for LCA (0.12.3) which will fix rpmbootstrap for lastest Fedora (18-20), Mageia 3 and also other recent distros. Also as SVK is now broken on Mageia 3, I’m using git-svn to work on my laptop when remote, and thus pb supports it now. Some various fixes since last year release will also be done (better printing with VM/VE name for logs, improved ntp support, pbdistrogetparam command to easy shell interface…), but globally the software is pretty stable for my usage, so now it’s your turn to tell me what would be useful for you in it. I also need to make a newer presentation for Monday with a short demo.

For MondoRescue I’m not ready yet to publish a final version, so I have made for now a first beta for the 3.2.0 version. First this will be a new 3;x version as there are lots of changes in the code that may make it less reliable due to the adoption of dynamic memory allocation instead of static in a lot of functions. If I compare 3.0 and 3.2:

  • 3.0
    • total mr_asprintf usage : 646
    • total sprintf usage : 674
    • total strcpy usage : 560
    • total fgets usage : 79
    • total malloc_string usage : 367
    • total MAX_STR_LEN usage : 370
  • 3.2
    • total mr_asprintf usage : 1223
    • total sprintf usage : 166
    • total strcpy usage : 388
    • total fgets usage : 28
    • total malloc_string usage : 129
    • total MAX_STR_LEN usage : 221

Which means that a lot has been done in code changes between 3.0 and 3.2. But also a lot remains to do if we want to have no malloc_string nor MAX_STR_LEN at all. And also if I made mistakes in the mr_malloc/mr_asprintf/mr_free usage, the commands will crash. THat’s why I need your tests here ! I’ve made a full bakup restore cycle (which has revealed some issues that I fixed), but I’m far from being confident in the result.

Another consequence is that this version will probably have less fixes than previous ones as most of the time has been passed on code modernization.

And it will require new mindi and mindi-busybox versions. And these versions should finally work for systemd crazyness of removing /bin and /sbin (which broke MondoRescue for a too long time now). And you’ll need new perl modules in order to have it work correctly as I finally rewrote some bash mindi functions into perl to have what I consider better code.
Which means Fedora 18-20, Mageia 3 should work out of the box (at least my Mageia 3 now works correctly).

And expect again more pacthes to MondoRescue durnig the 28+ hours back home at the end of next week ;-)

So I wish to all readers a happy new year 2014 and hope it will start for you as it has for me !

Meeting at Linux.conf.au in Perth

2013/12/21

I’m again lucky to be able to fly in a plane for 20+ hours the first week of January to attend Linux.conf.au ! (And of course the 20+ hours of fly back ;-))

I’ll talk on Monday 06 January 2014 during the miniconf dedicated to Developer, Testing, Release and Continuous integration Automation of project-builder.org and the idea of Continuous packaging.

This has been possible only thanks to HP‘s support, its Open Source investment council, and the kindness of our VP & Deputy General Counsel, Cloud Computing and Open Source Eileen Evans who continues to support my travels at many Open Source conferences, and should be greatly thanked for that.

I’ll make a new version of the tool available to celebrate this, not that a lot has changed, but some fixes should be made available as packages, and it’s a long time since I published the last one. In fact, for me the tool is pretty stable and usable. I recently added git-svn support, as svk is broken with latest perl versions such as on my Mageia 3 :-( So learning slowly git, and still not liking it that much, but I have not a lot of other choices.

I still need to improve rpmbootstrap for the latest Fedora which changed their mirroring structure. Hopefully this will be done on time.

And as I’m on it, Merry Christmas and Happy New Year to you all readers !

Distro Recipes 2013: Nice first !

2013/04/09

Distro Recipes 2013
As indicated, I had the opportunity to talk during the first Distro Recipes event organized in Paris last week, at the invitation of Hupstream. As Yoann Sculo posted, this was a very interesting day for me, and I really regret I was busy to also attend the first day and the opening.

After a nice welcome breakfast, Aurélien Bompard started by presenting the Fedora distribution.
Aurélien Bompard presenting the Fedora distribution
He did a great job especially expalining how easy it was to become a Fedora maintainer, even if a comparison to Debian revealed that it’s much less different that what people may think (it also takes time to become a packager able to modify most distro packages) and I know by experience that the Fedora packagers are really picky (sometimes for not so good reasons) with new contributions.

After that I talked about HP and Linux distributions. I used in fact the standard HP marketing presentation of the company as a starter (modified of course to suit my needs and include more penguins !) in order to explain the span of our activities, our relationship with communities including distributions, announced that HP will even soon provide firmware for ProLiant servers under a package format (rpm and deb), the fact that HP doesn’t see Linux demand for desktop/laptop on the consumer market (no, it’s not just a price issue that would make Linux more appealing in that case as I justified) but that we do support Linux on some enterprise desktops/laptops. Hopefully this was useful and/or new to some of the audience.

Then Dodji Seketeli made the type of talk making you believe that you could contribute to gcc ! Of course, when he details how much time it took him to add some of the features of the next stable version, you know you can’t ! Well I at least ;-) Anyway lots of good news and features that make that future version 4.8 expected soon.
Dodji Seketeli on gcc

That conclude our morning sessions, and it was then time to eat !! Especially as we had a great buffet waiting for us as you can see:
Repas midi

In order to avoid a sleepy afternoon, we started right after by a round table with 7 people (!), that I had the pleasure to chair. With a representative of each distribution (Mageia, openSUSE, Fedora, Debian, Arch, Embedded) and a Microsoft representative, you could expect blood and swords fight ! Not at all, I was surprisingly happy that the elements were clearly exposed, each representative defending their own work rather than criticizing, and finding ways to propose more future joint work. Of course, some subjects such as LSB/FHS lead to more debate, but very constructive and I really enjoyed this time slot as a way to show that differences are an added value ! It was also the opportunity for me to meet with Colin Guthrie and Frédérc Crozat, which I had never met before. These distros should be happy to have such representatives defending them (and the others too of course ;-)) Finally if you have ideas to share to improve cross-distribution work , consider joining the mailing listdedicated to his topic and start sharing your ideas.

Then it was time again for the remaining presentations. The first was Lucas Nussbaum. Long time Debian Developer, (he is even running for the Debian Project Leader now, vote for him !) he made a convincing picture of the Debian ecosystem, the numerous Web sites that contributors can create to enhance the distribution with stats, infos, Ubuntu correlations, … As usual, Debian appears as a very mature distribution, with a strong Governance, being perl friendly… If I had to change I may well become a debianers. But isn’t it because of the pres, as the morning I was a fedorian ;-)
Lucas Nussbaum pour Debian

The next speaker was a long time Linux enthousiast Pierre Ficheux. In fact back when it was Minitel time (not 2.0) I used his xtel program !! Pierre made a presentation (in english but with the accent ;-)) around embedded Linux distributions, presenting various way to tailor one for your device (he was using a Raspberry Pi) depending whether you use an Ubuntu, a Yocto generated one or a pure OpenEmbedded linux one. Definitely a good idea to explore for my Pi !
Pierre Ficheux sur Yocto (Open Wide)

And then we had the lightnings talks. Aurélien Bompard was there again for HyperKitty. Too bad it’s devoted to mailan, as I think Sympa would also benefit from such a work, as their archive management (at least on the latest versions I used) could be improved.
Aurélien Bompard pour HyperKitty

I came then again on stage for a project-builder.org presentation (building cross-distro packages for upstream projects) and made a short demo which I think is explaining much more than my slides, so I plan on using it more in the future !

After me, Eric Leblond explained how his upstream project (ulogd2) wasn’t picked up correclty by most distributions and asked for help to improce that.

And final speaker was Nicolas Vérité who made a panel on all mobile Linux distributions, recommending to follow closely Tizen for the future as the main force in this area.
Nicolas Vérité sur Distros Mobile

Too bad it was already over. Anne closed the session and I’d like to thank her for the invitation and the perfect organization of this first cross-distributions vent as a real success. Well done and see you next year hopefully !
Anne Nicolas (Hupstream)

Meeting at the first Distro Recipes

2013/03/19

I’ve been kindly invited for the first Distro Recipes event in Paris the 4th and 5th of April.

As I have an internal HP meeting on the 4th, I’ll be only available at the end of that day, but will present on the 5th how Hardware manufacturers work with Linux distributions, giving the example of HP. I’ll also monitor a round table aound “Linux distributions: differences and commonalities” where we will try to have polite discussions ;-) about what makes a distribution unique, and what is instead worth sharing by collaborating. Finally I’ll also present during the lightning talks “Project-Builder.org: packaging for multi-OS Open Source Projects

So won’t have that too much time outside of presentations, as you can see, but would be happy anyway to meet with MondoRescue or Project-Builder.org or HP/Linux users and talk with them.

Anyway a great event to be in, as the list of speakers is really interesting, all majors distros being represented, and for sure very interesting new contacts to make, and hopefully the curiosity to discover these other distros that you don’t use :-) Come for the same reasons, and see you there !

MondoRescue 3.0.3 is finally out

2013/03/17

I know. It’s been a long process. And I’m not even fully satisfied with the results, as we do have unresolved bugs in this version. But as it also fixes some critical others that were expecting for a long time (3+ months), I didn’t want to delay more the release of this version.

So here it is. mondo 3.0.3, mindi 2.1.4 and mindi-busybox 1.18.5-3 are now availble from the master ftp server. And as given in the announce, most of the distributions (nearly 100 of them) also have packages ready for use. Once more couldn’t do it without project-builder.org :-)

The detailed change logs are available for mindi, mindi-busybox and mondo.

Among the main fixes brought by this version, a much better support of SLES 10, SLES 11 SP1, SLES11 SP2, especially for LVM and device exclusion, grub, keyboard.

I also received very, very valuable contributions from users, which helps producing a better version of course, and reduce the time of the resolution of the problem in the upstream version. Thanks again for helping ! Including on some very old bugs. And Victor being one of the most prolific.

There are even some new features such as the support of swaplabel or the inclusion of all tools part of minimal.conf now in the first boot part.

As said earlier, some bugs ar not fixed yet. I passed most of the week trying to fix the automatic mode where CTRL-ALT-DEL doesn’t work. I added support in 3.0.3 of an inittab file, but whatever the conf I use fo now, it doesn’t trigger a reboot when using the magic key or sending it from the KVM monitor. So be warned and use with care. I’ll report on the busybox ML as I still have the issue with 1.20.2, and try to get help from this community. Could well trigger the release of a new mindi-busybox (and maybe mindi) soon after this one.

In the serie of un-fixed bugs for lack of time for this time are some that a user reported as more important to fix soon:

  • Ticket #628: 3.0.2-1 Fail to Restore from External Hard Disk – This is a very big issue here.
  • Ticket #641: Specifying the Same Backup to NFS via CLI=Success via GUI=Fail – Although it is possible to work around this problem it is preventing the creation of exceptional backups by users with little knowledge of Mondo. A fix will be most welcome and will present a more appropriate impression of Mondo.
  • Ticket #640: mondo.tmp.xxxxx & mondo.scratch.xxxxx Issues – This is not a critical issue. A fix will help with backup management and housekeeping tasks.

I globally agree these are also important to fix (even if less than Ticket 627). I also think we need to work on Ticket 656 as well. I’d like to get your comments as well in order to prioritize the fixes in the next version, as I can’t work full time on MondoRescue, so need to choose where to put my efforts.

Finally time to publish pb 0.12.2

2013/03/01

As you can see with the few messages I had time to post on this blog, the end of 2012 start of 2013 has been pretty busy, and I’m late in delivering the 2 projects I’m leading. So this week, I decided it was time to make a 0.12.2 version of pb, and make it available. Was asked by my colleagues of FOSSology, specially to add Fedora 18 support, so I also build my VMs to make packages on this distro.

BTW, a bit of ranting for Fedora once more: no perl by default :-(, and no ifconfig nor route command either which is breaking MondoRescue of course, and I guess tons of other software around. These guys don’t care about past, but don’t provide compatibility tools either !! So I’ll have to make new patches, just to do the same as what was done, but with another command again. Not to speak of systemd which I still have issues to deal with :-( That doesn’t make stuff go faster !

Anyway, the version is now out, no official bugs fixed, but a lot of small stuff here and there which were desrving a release. No time to test Fedora 17/18 VE yet, so you’ll have to do that yourself if you want. I also had a look at virsh usage in combination with pb, and it’s again not as easy as it could seem to be. Especially port redirection I’m easily using by launching qemu-kvm manually with the -redir or hostfwd option doesn’t seem to be possible with the user mode network through virsh (neither manager nor CLI). Will have to post on their ML to see how they do that, if they can !

And MondoRescue has been very late. I really need to publish a verion, but I still have some blocking bugs I really would like to get rid of: CTRL+ALT+DEL not working anymore during restore, some LVM issues on RHEL, some grub issues on SLES… Hopefully at the end of next week I’ll have made progresses.

Of course patches are much easy to integrate, but I receive more bug reports than them ;-)

And also back to preparing the HP internal TES event, Solutions Linux confs, submitting to LinuxCon, working on an FLOSS ITIL stack, learning more OpenStack, looking at Intel’s TXT…. so many things I’d like to do or learn and will never have time to ! Maybe at least I’ll talk about that another time.

Last 2 weeks too hot…

2012/07/07

Had lots to do during the last weeks. New MondoRescue Version, new project-builder.org version, Solutions Linux event in Paris, new HP internal projects, and on the private side rehearsal + concert and vocal ensemble conducting, finding a room for my daughter next year in Paris for her studies was a bit too much, with not enough sleep.

Was completely tired last thursday, with 39°+, and slept most of Friday as a consequence. Saturday, I still had not completeley recover, Not a real serious burn out, but made me think I was probably in need of rebalancing a bit stuff to avoid a serious one. And it took me nearly a week to recover, even if I dstill don’t feel exactly as before.

So I’ve just restarted this week to work on some mindi patches, and even if I planned to release a new version of mindi during the week-end it will now be during this !

I’ll be on vacation next week, for my yearly renaissance music week near Paris. So if you want to meet, for once, it will be at one of the concert we will perform the 13th, 14th or 15th of July as explained in the link ! Hopefully that change of activity will let me rest a bit a come back stronger :-)


Follow

Get every new post delivered to your Inbox.

Join 102 other followers