FilesExpand file tree

 master

/

test_6.py

Copy path

Blame

More file actions

Blame

More file actions

Latest commit

 

History

History

History

41 lines (28 loc) · 1023 Bytes

 master

/

test_6.py

Copy path

Top

File metadata and controls

• Code
• Blame

41 lines (28 loc) · 1023 Bytes

Raw

Copy raw file

Download raw file

Open symbols panel

Edit and raw actions

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

"""

Testing code for different neural network configurations.

Adapted for Python 3.5.2

Usage in shell:

python3.5 test.py

Network (network.py and network2.py) parameters:

2nd param is epochs count

3rd param is batch size

4th param is learning rate (eta)

Author:

Michał Dobrzański, 2016

dobrzanski.michal.daniel@gmail.com

"""

# ----------------------

# - read the input data:

import mnist_loader

training_data, validation_data, test_data = mnist_loader.load_data_wrapper()

training_data = list(training_data)

# ----------------------

# - network2.py example:

import network2

# chapter 4 - The vanishing gradient problem - deep networks are hard to train with simple SGD algorithm

# this network learns much slower than a shallow one.

net = network2.Network([784, 30, 30, 30, 30, 10], cost=network2.CrossEntropyCost)

net.SGD(training_data, 30, 10, 0.1,

lmbda=5.0,

evaluation_data=validation_data,

monitor_evaluation_accuracy=True)