FilesExpand file tree

master

/

relu.py

Copy path

Blame

More file actions

Blame

More file actions

Latest commit

 

History

History

History

40 lines (28 loc) · 1.09 KB

master

/

relu.py

Copy path

Top

File metadata and controls

• Code
• Blame

40 lines (28 loc) · 1.09 KB

Raw

Copy raw file

Download raw file

Open symbols panel

Edit and raw actions

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

"""

This script demonstrates the implementation of the ReLU function.

It's a kind of activation function defined as the positive part of its argument in the

context of neural network.

The function takes a vector of K real numbers as input and then argmax(x, 0).

After through ReLU, the element of the vector always 0 or real number.

Script inspired from its corresponding Wikipedia article

https://en.wikipedia.org/wiki/Rectifier_(neural_networks)

"""

from typing import List

import numpy as np

def relu(vector: List[float]):

"""

Implements the relu function

Parameters:

vector (np.array,list,tuple): A numpy array of shape (1,n)

consisting of real values or a similar list,tuple

Returns:

relu_vec (np.array): The input numpy array, after applying

relu.

>>> vec = np.array([-1, 0, 5])

>>> relu(vec)

array([0, 0, 5])

"""

# compare two arrays and then return element-wise maxima.

return np.maximum(0, vector)

if __name__ == "__main__":

print(np.array(relu([-1, 0, 5]))) # --> [0, 0, 5]