Jose
Jose 5 min read Data scientist from Alcalá la Real. Studied at BarcelonaTech, worked as a researcher at the UGR and UPC, was a machine learning engineer at El Ranchito and Nemeda and now work in Koh Young Research Spain. Always wanting to explain my knowledge to the world.

The Hack Life

Believe or not today I got up at 4am to take a train Madrid -> Barcelona to work for more than 24 hours straight for free. Why? Melancholy. Melancholy is such a strong emotion and it’s not given enough credit. We love to dwell in past memories and try to revive the happy ones. Today, I got the opportunity to feel a fading emotion: Youth. There are certain lifestyles and choices that get lost when we get older, more mature. Coding at 2am is one of them. It’s 2am again, and instead of coding this time I will be writing about my hacking adventures.

Okay, that was a quite poetic and obscure introduction. Quite contrary to the very specific intros that we are used to see in this blog. What is the hack life I mention in the title? Let me introduce you to the concept of a hackaton. Hundreds of students in the same place coding a solution to a challenge in a weekend. That is the official definition. Unofficially, a hackaton is a place to meet awesome friends, life-long friends, a place to learn from more experienced people about technical topics and receive advice about life. There are funny activities and deep lore. Like the ducks in the HackUPC. It was in my first hackaton that I met my crew. At that time we didn’t know each other but created a team and participated together. Now we are besties. How do we go from there to writing a post at 2am in a faculty where I no longer study? Stay with me, it is a long story.

biene

In total I have assisted to 6 hackatons / datathons. The HackUPC 2019, 2021, 2023, MamutHack, CFIS Datathon and Hacknights. After that, I wanted to be in the other side of the event, to be an organizer. I helped organize the second datathon FME on 2022 and today was the third datathon FME, which I am also helping organize. This is probably the last time I will be at either side of a datathon / hackaton. Only time will tell, but it definitely feels like so. I am in a position where I know personally many of the people that participate, being this either their first time or second time. I also know other organizers and I even know personally many sponsors, both in companies and universities. A datathon is the people that composes it. When time passes, and people goes, the datathon dies. Figuratively. For me. For others it is a discovery. (As a side note, when I was midway writing this paragraph the whole electricity of the faculty went off, more on that later). Where was I? Ah, yes, the cycle of the hackaton. You participate, you organize, you sponsor and you continue with your life. It is like that summer romance that you will never forget but you will also never continue with. That’s life, continuous change. No matter how hard you try to repeat some memorable memory, it will never be the same. You are not the same, can’t experience it the same way. You only have one chance to enjoy it.

Back to the hackaton stuff. Living a hackaton, and specially a HackUPC comes with lots of anecdotes. You may end up shooting nerfs to random scandinavian people. Or find a ruber duck below a random chair. The first time I participated I was sucked deep into the challenges. Full focus in coding and giving the best solution. Spoiler: It was not. As a first year student you have no experience nor knowdledge. And this type of challenges would normally require months of full-time work to fully develop. You are only supposed to build a quick MVP. But the first (and second) time, it is about learning. The real challenge is to learn to code and code at the same time. Do you want a webapp? Great! Learn Javascript, HTML and CSS all at once from scratch and then apply the knowdledge. Do you want to build a vision classifier? Fantastic! Look for a github repo with a pretrained classifier, learn how to tweak the solution to your needs and do it. It is a way of learning by building. By hacking. If something does not give the perfect solution, instead of doing a whole course to fix everything you just learn or create any trick that does the job. The power in it comes from doing it during 36 hours straight. It is a very condensed way of studying. I will probably never be as focused as I was in those first hackatons.

focus

Once you get older you start valueing other aspects of the events. More personal. Less technical. And that is when I knew I preferred to deliver food and give advice rather than to code. When you are a volunteer, everybody asks you. You get to know many more people. And you get to see wonderful ideas. When I was participating it was all about me, about my solution and my algorithm. Which is fine. However, when you start hearing many team’s ideas you learn a lot. In this datathon I was surprised several times with the Mango challenge. Mango brought a problem where you were given a set of good-looking outfits and where asked to analyse it and recommend 10 new outfits. Said like that is looks quite interesting. But if you know a bit about machine learning you know this problem is ill-posed. You only have positive labels. It is the most imbalanced dataset possible. My first thought was to simply create ugly outfits and label them as negative. But this approach is highly subjective which will make the model subjective. Teams came up with way better methods. One suggested to build a classifier with pairs of garments. Every outfit is composed of several garments. You can construct positive pairs by looking at existing combinations and consider every combination that is not in the dataset as negative. This is a natural way to recover the balance in the dataset. It is not perfect, but is a very interesting idea. Other team tried to build a markov model and construct the outfit iteratively. To learn the probabilities they just assumed independence between attributes and computed ratios. Simple, yet possible useful. Maybe these approaches get you nowhere, but the ideas are amazing. The creativity is not something you can learn. Everybody is creative in its own way. Being a mentor provides you with the opportunity to discover new ideas from others.

creative

In the second datathon FME, the first I helped organize I discovered this new world. And I met lots of mentorees (I can’t find an appropiate enough word for this type of relationship). Meeting with them again, seeing how they have evolved it’s what fills me. That and coming to see my crew again. All the work that needs to be done, moving tables, giving food, solving doubts. It is all paid in a different way. As an unforgettable experience. This is the reason when this datathon was announced I immediately bought tickets to come here from Madrid. And what a datathon. There is yet one day to come and it is already my most memorable datathon. Last year some students built a tower of plastic glasses as big as a person and enclosed a person in it. Well, this datathon also had some architecture classes. This time with pizza boxes.

arc

It was a bit chaotic and full of rustle up. There are 100 more students and we tried the same logistic strategy which didn’t work as well. We learned a lot in the process and manage to get everyone fed which is a major statement. I also guided many people with ideas on how to proceed with the challenges. From my perspective, I am only giving ideas. I know perfectly that implementing such ideas is the real deal. And sometimes they look at me and say: “Yeah, putting the data in wide format, then one-hot encoding it and apply a PCA sounds fine, but how the hell do I do that?”. Others are more advanced technically, but less knowdledgeable in project management. Surely you can apply a very complex network, but have you tried a linear model as your baseline? There are many ways to arrive at a solution. Some are way harder than others. Advancing in the right direction can save you time and headaches. Sadly, you only learn that with experience. No matter what I tell them they will make the same mistakes as I made. And that is the beauty of life. At least I can warn them about the difficulty of the process.

Remember the light incident I told you about before? The organizers also have our challenges. Buying 7kg of yogurt at the last moment because we miscalculated how much was needed was one of them. And another challenge was dealing with plug shortages. Being so much people, all with computers, requires electricity and plugs. The building was not prepared for so much load. First, we needed to buy more adaptors to cover the demand. And in the middle of the night, at the most unexpected moment, the net got overloaded. Part of the job.

encogerse de hombros

So that’s the hack life. A very short life. It became a part of me when I started university and it is leaving me now that I am leaving university. When I get older I will look back and remember with melancholy those years. With the nostalgia of a time that cannot be recovered, but that was spent in the best way possible.