Posts Tagged ‘packaging’

An end and a new start

2019/03/22

After nearly a year, I’ve now been declared in remission with my lymphoma. So that’s the end of this period. But I’m not completely done, as I’ll need to regularly check it’s not coming back. Being cured, is only possible after 5 years of remission. And I now need to return all the care my wife gave to me to her, as she was diagnosed with a breast cancer back in october 2018, operated immediately and she’s now in the mid of her own chemiotherapy, before radiotheray. So the real end should rather be around june this year, if everything continues to be for the best for her as it also seems to be (she had a much less streamlined relationship with the hospital, but that’s another story).

So now, it’s time to start again working full time to HPE (next week officially, even if with the recent events, I’ve been more than half time) and to come back to my FLOSS projects that have been suffering themselves meanwhile.

And the first one, as it’s the basis of the rest forme, is project-builder.org. I already had made modifications to use YAML type of configuration files, instead of my own format up to now (well, when I started back in 2007, YAML wasn’t as popular as it is today) but didn’t had time to test on other projects and publish and of course I also fixed some bugs such as:

So as of now, version 0.15.1 of project-builder.org is available and ready for you to test and thus improve your Continuous Packaging approach as part of your automation chain. Enjoy !

And now that my production toolset is ready again, I can come back at last to MondoRescue to publish that version that as been waiting for way too long now. Expect news in the coming weeks.

Fosdem: always impressed

2019/02/07
Université Libre de Bruxelles hosting Fosdem under the snow on saturday

While I’m coming back from Fosdem, A big Kudos to all the volunteers and the team in charge. It’s the largest and greatest FLOSS event WW. I’m always impressed by what a dedicated community can achieve. It was the most crowdy edition I’ve been able to attend. Some rooms were very difficult to enter in, with long queues in front of the door. So in order to attend the sessions you were interested in, you had to enter if possible 2 or 3 sessions in advance to be sure to have a seat for your preferred session ! What a success 😉 Drawback is it makes it difficult to change track, more over changing building as you’re sure to have to wait for the next session in that case.

Small part of the queues at lunch time at Fosdem

The logisitic is incredible, timing respected for the 700 sessions delivered with live videos taken, and when you are speaking you receive a mail less than 30 minutes after the end of your talk to ive you the link to review it ! Really awsome. The only drawback was the lack of VGA support on their recording system: only HDMI was available. By luck my laptop had also a Display Port output so adapters were available so you could project. However, some speakers had issues with that setup, such as during the upt session where no vide cold be used at all. The speaker, Cyril Roelandt, made the full presentation without slides, explaining event the architecture diagram in both a very professional way and with a marvelous sense of humour. As he said we will long remeber his talk. But also for the idea and the tool he is working on. We had a quick hacking session afterwards and that was very insightful.

On saturday, the sessions I found interesting were on LibreOffice, the one on server side solution for generating ODF reports (much more interesting if you understand chinese for sure, and no I don’t 🙂 and the other one on relaunching the ODF adoption TC at OASIS, where my proposal of useing the term Advocacy instead of Marketing was well received (public sector organizations are much less keen to participate to a “Marketing” TC, but much more to an “Advocacy” one). Michael Meeks was as brilliant as always in his covering of LibreOffice Online.

Another initiative of interest was the presentation of the LibreHosters, even if they have less hosters WW currently than the CHATONS in France, while aiming at the same goal, neutral and transparent hosting using FLOSS.

I attended the Eventyay presntation to see whether they were supporting multi-site events sur as our FLOSSCon, but it seems they don’t do better than the OSEM we use. I stayed in the room and followed the sessions on OCP and Skulls, but the more interesting one for me was the following on bmclib. The engineers at booking.com have published under the Apache v2.0 license their internal work on BMC abstraction through an API. For someone like me interested by Redfish it was a must attend session 😉 And the discussion outside the room which followed was as well.

I had a nice dinner with some members of the french FLOSS community I had not seen for a long time and that’s one of the reason for me to attend Fosdem.

I had a very short night after that as I proposed to the distribution room to take an empty slot due to the illness of a speaker and to use a proposal I had made and that had not been retained to fill the gap, which was accepted. Of course, it was the first session in the morning, while I also had the last of the day 😉 So slides and demo to verify at night and here you go after 4 hours of sleep you’re back to the event 😉

So I talked about Packaging for Mageia Linux with Docker containers, which I could demonstrate in front of a nearly full room (50+ people) at that time in the morning, after the previous night ! Waoh ! What a level of commitment from the audience, I was really surprised. I stayed then in the distribution dev room to follow a similar presentation around Linux distributions, lifecycles, and containers which was in fact around the new Fedora modularity principle. The grub presentation following was too cryptic for me, as I don’t follow closely the project so too many elusive sentence were given so I could reall yunderstand the new devs made. But I had a seat for the upt talk mentionned upper 😉

I then moved after the upt hacking session and lunch to the Hardware enablement devroom to be ready for my formerly only official session of the event. It was dedicated to Redfish: the new standard for a Software Defined Infrastructure and I was surprised again so that so many people preferred to be there rather than drinking a beer.

I didn’t had time to see the kenote of J.M. Hall as I had to catch my train afterwards. So again big kudos to all the people involved in that event, who make them the FLOSS reference and surely an inspiration for our own FLOSSCon 😉

Slides are already available and videos should be soon as well. See you hopefully next year there !

Meet during the Open Source Summit in Prague

2017/10/16

Getting approval for my participation at that conference was the toughest I ever had in the past, but I’ll be there again after having spoken in all the previous editions.

This time, this presentation will be made by a duo, as I’ve worked since the last LinuxCon EMEA with the FOSSology project to help them adopt a Continuous Packaging approach and Michael Jaeger from Siemens who leads the project will be with me to cover the topic. On my side, I’ll explain how project-builder.org was used, the setup done with Vagrant and containers to generate packages for 7 different Linux distributions (ongoing effort as we speak ;-), automating fully the production of packages as part of the LinuxFoundation build infrastructure for FOSSology. And of course the changes I had to make to the code to better support the project needs !

So I’ll be back in Prague (no problem as I love that city !) next week, to celebrate also the 10 years of project-builder.org, just after my week at DockerCon which is really starting today !

Meet at DockerCon Europe

2017/10/12

This is a late announce, as I wasn’t sure to be able to attend the event, but now everything is on track and I’ll be at DockerCon Europe next week ! One of my proposals has been selected as a 20′ session in the Community Theater and I’m glad as this is the first time I can participate to DockerCon. Project-Builder.org is using Docker since September 2014, so I’ll be able to celebrate the 3 years of Docker usage in pb after the 10 years of pb itself 😉 More seriously my goal is to promote again Continuous Packaging and demonstrate how beneficial it has been to introduce Docker in the chain, and how my upstream projects, as well as FOSSology are benefiting from it. Come to see that !

Of course, HPE is a platinum sponsor of the event so if you’re one of our customers, I’d also be happy to talk with you around your Docker projects as HPE is sponsoring my travel there ! (Thanks to the management to support again this despite hard times for travel requests and the HPE Next plan). Maybe I’ll still have a job when I’m back … or not 😉 Anyway, will see later as I’m now busy preparing my slides and demo for DockerCon among other stuff. See you there !

This week, gift continues with project-builder

2017/03/08

Normally, today I receive gifts, priviledge (really ?) of being older 🙂 But I can also make gifts myself ! So after python-redfish 0.4 yesterday, I’m announcing the release of project-builder 0.14.3 today (and maybe more to come later this week !)

This project seems to have a quicker pace than MondoRescue, maybe due to the fact I’m using it daily, and that it’s now used by python-redfish, MondoRescue, and also FOSSology (WIP more on that later again). I realize I didn’t announced previous versions 0.14.1 last July, and 0.14.2 last January, but lots have been added since.

I’ve worked on this version to improve deb support (no arch pkg) and especially deb repositories (with GPG keys) as well as OpenSUSE GPG signed repositories as well. Previous versions brought support for latest distros (Fedora 25, Ubuntu 16.10 e.g.), robust build using Docker in addition to VMs or chroot VEs, fixes some issues around conf files analysis, improving rpm package name for smooth upgrade between test and stable versions, renaming temporary dirs for consistency, as well as moving the main conf file outside of /etc reserved for local modifications, … Changelogs have all the nasty details.

One of the task I’d like to make now is to move the conf file format to JSON, to benefit from existing libs to manage them, and make them even easier to deal with. That would allow some other improvements afterwards, but too early to talk about.

Oh, and BTW, we decided to also publish python-redfish 0.4.1 (with its packages made with project-builder.org to keep this article’s focus 😉 ) to fix a nasty error we made when pushing to pypi. Enjoy as well !

Meet during LinuxCon EMEA

2016/09/23

After having talked on project-builder.org during the latest LinuxCon NA in Toronto, it’s now time to prepare for LinuxCon EMEA in Berlin.

I’l again talk about packaging, this time “Packaging for Linux Distributions with Docker“. And I’ll also replay the now popular (!) “101 Docker training” I’ve also delivered in Toronto, this time trying to deliver it before the one Jérome Petazzoni from Docker is doing on Docker orchestration, in order to allow for a complete overview of the Docker ecosystem.

Of course I’ll enjoy attending many sessions on various topics, and will see if in EMEA as well Docker Orchestration is the new Eldorado this year (In Toronto many talks and booth were dedicated to that theme). At least my colleague Mike Bright will cover it well !

See you around !

Project-Builder 0.14.1 is now out for LinuxConNA !

2016/08/19

Well, in fact I froze that version back in July, but didn’t officially announced it till today (vacations were just in the middle). So that version 0.14.1 is now available, it breaks compatibility with previous ones, so you’ll need to update your VMs/VEs with it as well if you want to use it correctly (that’s why it’s still version 0.x !)

But I’ve been able to build a lot using docker containers with that version, and I’m now more and more happy with these results. Especially because it’s easier to fully automate an environment from absolutely nothing except project-builder.org to working packages. I already described it when I released 0.13.1 last year through a short tutorial, but it’s really working reliably now for a large set of distributions:

$ docker images | grep pb-pb
pb   mageia-5-x86_64-pb-pb              fc479023c876        3 weeks ago         413.9 MB
pb   opensuse-13.1-x86_64-pb-pb         2c31c56e7bda        3 weeks ago         354.3 MB
pb   opensuse-13.2-x86_64-pb-pb         c8edeba0440b        3 weeks ago         438.2 MB
pb   opensuse-42.1-x86_64-pb-pb         8e91d2b584ed        3 weeks ago         461.5 MB
pb   debian-7-x86_64-pb-pb              0c133063d4be        3 weeks ago         449.8 MB
pb   debian-8-x86_64-pb-pb              8fb919480351        3 weeks ago         588.3 MB
pb   centos-5-x86_64-pb-pb              c8b6f1a0846b        3 weeks ago         706.6 MB
pb   centos-6-x86_64-pb-pb              a3c1ea318031        3 weeks ago         545.9 MB
pb   centos-7-x86_64-pb-pb              d5790ee97e13        3 weeks ago         392.1 MB
pb   ubuntu-12.04-x86_64-pb-pb          053f112ed939        3 weeks ago         398.2 MB
pb   ubuntu-14.04-x86_64-pb-pb          bc239427fc3a        3 weeks ago         501.7 MB
pb   ubuntu-15.04-x86_64-pb-pb          e6cf8d0fafd0        3 weeks ago         503.8 MB
pb   ubuntu-15.10-x86_64-pb-pb          dba3b580bdc8        3 weeks ago         550.1 MB
pb   ubuntu-16.04-x86_64-pb-pb          02a337752837        3 weeks ago         522.9 MB
pb   fedora-21-x86_64-pb-pb             07223685d24f        3 weeks ago         965.1 MB
pb   fedora-22-x86_64-pb-pb             211b865c1ec6        3 weeks ago         749.5 MB
pb   fedora-23-x86_64-pb-pb             f6012ff7b6b8        3 weeks ago         879.6 MB
pb   fedora-24-x86_64-pb-pb             6d878b489584        3 weeks ago         678.5 MB
pb   gentoo-nover-x86_64-pb-pb          b6ead3da5b85        4 weeks ago         1.392 GB

But I’ve not really worked yet on the ideas expressed when I issued 0.13.2 in February this year.

Instead I’ve done other improvements such as managing signed deb repositories (was asked for a long time), have a better naming for temporary versions (allowing easier updates between temporary versions and also with stables, but creating the incompatibility with 0.13.x), docker tests for lots of distributions (paving the way for automatic testing here from nothing to package build), adding support for pbr, standardizing temporary directory names, …

That will be the version I’ll use to make demos during my presentation next week at LinuxCon North America in Toronto as already announced. Come to see it live and so that we can discuss continuous packaging !

Meet again next week in Paris and at LinuxCon NA 2016 in Toronto

2016/06/19

I’m just back from an HPE Event (the ETSS in Gothenburg, Sweden) and will soon have to start the next ones.

First, I’ll be this week in Paris to talk during a MySQL Meetup to cover automatic deployment, in particular with Redfish, images of reference (and a bit of MondoRescue) and automation (ansible e.g.) for DBA.

Then I’m again lucky this year to be retained as a speaker for the upcoming LinuxCon North America which will be in Toronto, Canada from the 22nd of August to the 27th. I’ll have a session on Continuous Packaging, mandatory for DevOps and a 3 hour Initiation Lab on Docker. Interestingly enough at the same time, Jérôme Petazzoni, Docker, will do one on Swarm !! Maybe we should coordinate and make them one after the other (I’d like to attend his Lab BTW !!)

I have now put all my lab material that I do for HPE on GitHub, to make it easier for attendees to report errors, and for others to use them and learn. I have content for Docker (Done with René Ribaud, Yann Allandit, Michael Bright), Git (Done with Clément Poulain), Redfish (Originally written by François Donzé and done with René Ribaud) and soon for Ironic.

Hope to be able to meet with you here or there !

python-redfish reached 0.3, first interesting version for others

2016/05/12

Back in 2015, during our internal TES event in Grenoble, a group of people gathered to talk about the new Redfish DMTF standard and how we could add its support into Ironic.

Since that, we have worked first on a new Open Source python library to interact programmatically with Redfish 1.0 based systems.

We tried to promote it during OpenStack Summits but except in Vancouver when I did a short video explaining that, not enough interest from the community. Of course we had very few to show at that time.

One year after, we have now reached version 0.3 of the project. And while that doesn’t sound a lot, in fact the libray is now usable by others to interact with Redfish based systems.

What it provides:

Our next steps are in multiple directions:

Hopefully, as you’re reading this, you’re interested by the topic, and we’d be happy to get your feedback, and more over your patches in order to improve our work, and speed up the development !

And don’t forget the HPE Open Source project available as well on github which provides much more capabilities, due to its support of the iLO and iLOCM extensions to the Redfish standard.

Project-Builder.org reaches 0.13.2

2016/02/24

Before leaving for a 15 days trip to the US, I’ve published the latest version 0.13.2 of project-builder.org.

It will be very useful for my colleagues and friends working on python-redfish to make local packages for testing that module, and then to publish it in upstream distributions such as Mageia and Fedora to start with.

That version improves git support, ssh support with ECDSA (for RHEL 7 distributions which have removed DSA by default), provides Fedora 22 and 23 support as well (with dnf).

Of course, project-builder.org is available for 160 distribution tuples because it uses project-builder.org to make that possible ! And if I can do that for this project, then you can probably do it as well for yours. The goal again is to help upstream projects to provide upstream packages for various distributions to help users, testers to install the software on their system. And so is the tool itself, you can download it easily and test it following the instructions described in the Lab document.

I have the intention to work next on improving the conf files to support regular expressions for the labels (to allow making conf entries such as minosdep fedora-2[0-9] = ….), looking at transforming them to use JSON instead of their own format (JSON wasn’t an option when I started back in 2005) and also looking at the Swagger2 perl module to help build a RESTful API around project-builder.org

As usual, that’s not the lack of idea which is preventing all that to arrive but the lack of time. So don’t hold your breath if you plan to do GET/POST request to build your packages with project-builder.org but it will come. And now this version is available, back to MondoRescue to fix the UEFI support !