Shape the Technology that will Shape your Future

**Nagymaros AI Retreat**### 23 Oct - 1 Nov 2024

This year's theme: Knots

AI for Mathematics

In last year's AI retreat, we had lots of fun applying ML to an interesting maths problem, so this year's retreat will go all in. We will focus entirely on working with mathematical data: knots. Knot theory is an interesting area of mathematics with a lot of interesting structure, but a low barrier to entry. We will look into learning knot invariants, learning to unknot, factorizing composite knots into prime components, and many more.

Representation Learning and Geometric Deep Learning

We will learn about choosing the right, mathematically motivated architectures for the problems involving knots. There are several invariances that can be exploited in creative ways to make the learning problem easier, and the solutions more robust. We will explore concepts like circular convolution, convolutional transformers and more.

Reinforcement Learning

Several problems related to knots can be framed as Markov decision processes: similar to games like chess or go, but instead of a board, the state of the game is a knot, and instead of moves, we have mathematical transformations and operations to work with. This makes these problems an ideal playground to learn reinforcement learning algorithms, such as Monte Carlo tree search, Q-learning, and more.

## Sponsorship

#### This year's event is sponsored by G-Research. Thank you!

# Agenda

### Wednesday, 23 October

- Afternoon: arrival at Mihály utca
- 18:00 Welcome and Dinner

### 24 - 31 October - project work

- 8:00-9:00 breakfast
- generally working a lot
- also boardgames, walks, sports
- talks and seminars TBD

### Friday, 1 November - demo day and closing thoughts

- retro meeting (mad, sad, glad format)
- project presentations
- saying goodbye

Venue

### Nagymaros, Hungary

Mihály utca

Our home for the week is a nice house in Nagymaros, close to the train station with lovely views over the river and surrounding hills. The house has communal areas, a kitchen, and rooms with 2-4 beds in each.

# Speakers and Mentors

full list of speakers TBD

# Ferenc Huszár

**Professor of Machine Learning, Cambridge**I studied Computer Engineering at BME (Budapest) and got into machine learning after joining a computational neuroscience research group. After PhD in Probabilistic Machine Learning at Cambridge, I worked in tech startups and companies for 10 years. I joined Cambridge as an Associate Professor in 2020, where I built a research group on the theory of deep learning. I've been running AI retreats since 2022, I coach the Hungarian team for the AI olympiads, and I am a member of the Scientific Committee for IOAI.

# Bea Benkő

**Doctoral Researcher in Machine Learning, ELTE, SZTAKI**I have been studying Mathematics and Computer Science at ELTE (Budapest), and I am currently a final-year PhD student working on continual learning, representation learning, out-of-distribution detection, machine unlearning. After working for over two years as a software developer during my undergraduate studies, I joined the AI research group first at the Rényi Institute for Mathematics, and later at the HUN-REN Institute for Computer Science and Control (SZTAKI).

# Attila Sulyok

Doctoral Researcher in Machine Learning, PPTE

I'm András Attila Sulyok, a Ph.D. student at PPKE ITK. I did my Master's and Bachelor's in Computer Engineering here too. My research focuses on reinforcement learning and generative modeling. I've done my fair share of coding and implementing experiments, and I'm pretty good at visualizing results. I've also become more skilled at debugging than I ever thought I'd need to be. I enjoy explaining concepts and working with geniuses (or is it genii?), though I'm still improving at both. This year's knot theory topic interests me – I sail as a hobby, so I've tied my share of knots.

Participants

Full list of participants TBA

Benedek Labancz

12th grade student. Former AI Olympiad medallist, aspiring to study Computer Science. Self-taught coding enthusiast. Especially interested in the intersection of computing and cognition.

Balázs Szilágyi

A competitive programmer starting 11th grade at Veres Péter Gimnázium. Interested in optimisation problems, game theory and AI. Former Huawei Online ICPC Challenge prize winner, CEOI and I(OAI|AIO) medalist.

Gergő Lehotai

I'm an 11th grader passionate about STEM, with a focus on competitive programming, physics, math, and AI. Last year, I competed in the first edition of IOAI, where our team earned a silver medal.

Vince Ungár

I’m a 10th grader at Veres Péter Gimnázium, with my focus being on competitive programming. My main interests are AI, Mathematics and any problem-solving based task in general. IOAI and IAIO medalist.

Dóra Horváth

Started 11th grade in Győr this year. Interested in competitive programming and maths. EGOI bronze medalist in 2024.

István Ádám Molnár

I like trains; so hopefully, in this camp, stuff will be trained. At Olympiads I usually talk to Slovaks about linguistics. I'm really pedantic. Did you notice some of these descriptions are written in the first person while others in the third? The differing apostrophes? I did.

Miranda Christ

Started grade 12 at Fazekas High School. Has been working on ML, and specifically transformers, for quite some time as research assistant, youngest participant at EEML summer school, IOAI and IAIO silver medalist, competitive dancer.

Pál Czanik

12th grader at Fazekas High School in Budapest. IOI and IMO silver medallist. Into music as well.