Skip to main content

Maths and computer science · Ambitious · Dissertation or artefact

How a neural network learns: a maths EPQ idea

A title to start from

How does a neural network learn, and how much of it is calculus you already know?

Make it your own, then check your title.

Why it works as an EPQ

Gradient descent and the chain rule are A Level ideas at heart; building a tiny network shows exactly where they appear.

Scope and difficulty

Ambitious. Ambitious. A network with one hidden layer on a small problem, written and explained by you.

The maths

Builds on these A Level topics: Differentiation · Numerical methods · Algebra and functions.

You would learn:

One possible plan

  1. Fit a straight line by gradient descent and explain each step.
  2. Build a one-hidden-layer network and derive its updates with the chain rule.
  3. Train it on a simple data set and study the learning rate.
  4. Judge how far 'just calculus' explains modern systems.

Pitfalls

Where to start reading

Real data for this idea

  1. Primary source: Epoch AI data on AI models: AI models database. Download the CSV; use publication date and training compute (FLOP) for the notable models. Licence: CC BY 4.0.
  2. Readable chart: Our World in Data: Exponential growth of computation in the training of notable AI systems. Use it to see the pattern; download your numbers from the primary source or the chart's own download. Cite as: Our World in Data, ‘Exponential growth of computation in the training of notable AI systems’, CC BY 4.0. Original source: Epoch AI (2026).

Links checked October 2026; we link to the data and never copy it. More free data sets.

How to reference these.

Making something? Read the artefact guide first.

Frequently asked questions

Is this a good maths EPQ idea?

It can be. We rate it Ambitious: it suits students happy to read first-year university material. A network with one hidden layer on a small problem, written and explained by you.

What maths does this EPQ use?

It builds on these A Level topics: Differentiation; Numerical methods; Algebra and functions. You would learn: Partial derivatives; Gradient descent; Backpropagation as the chain rule.

Next step

Turn this idea into your own title, then check it in two minutes.

Check your title

Plan your timeline · How it is marked · Dissertation structure

Revising A Level Maths too? A free account saves your practice and progress. Join free · Sign in

Similar ideas

All maths and computer science ideas · all 93 ideas

Your EPQ must be your own work. How to use help and AI honestly.

The Extended Project Qualification is offered by several awarding bodies, including AQA, Pearson Edexcel, OCR and WJEC/Eduqas. A Level Math Revision is independent and is not affiliated with or endorsed by any awarding body or university. Summaries of the rules are in our own words: your school and your board's specification have the final say. Every idea here is our own.