## Description

Q1 (8 points): Logistic function: (see https://en.wikipedia.org/wiki/Logistic function)

1a (3 pts): What’s a logistic function? Write down the formula.

1b (2 pts): What is the standard logistic function? Write down the formula.

1c (3 pts): What is the derivative of the standard logistic function f(x)? Write down the formula.

Q2 (8 points): Sigmoid function: See https://en.wikipedia.org/wiki/Sigmoid function

2a (4 pts): What is a sigmoid function? Write down the definition.

2b (4 pts): What is the relation between sigmoid function and logistic function?

Q3 (8 points): Tanh function: (see https://en.wikipedia.org/wiki/Hyperbolic function and

https://en.wikipedia.org/wiki/Sigmoid function)

3a (4 pts): Write down the formula for the tanh function.

3b (4 pts): What is the relation between sigmoid function and tanh function?

Q4 (8 points): The softmax function:

4a (4 pts): What is the softmax function? Write down the formula.

See https://en.wikipedia.org/wiki/Softmax function

4b (4 pts): If a vector x is [1, 2, 3], what is the value of softmax(x)?

Q5 (18 points): Matrix: see Sect 1-3 of https://en.wikipedia.org/wiki/Matrix (mathematics)

5a (12 points): Let A =

1 2 3

4 5 6

7 8 9

and B =

2

1

3

what is A × B?

what is B × A?

what is the transpose of A?

what is the tranpose of B?

what are the dimensions of B?

what are the dimensions of the transpose of B?

5b (6 points): Let A =

1 2

3 4

and B =

2 0

1 2

.

What is A × B?

what is B × A?

Is matrix multiplication communtative?

Submission: submit only one file named hw.pdf or hw.jpeg to Canvas.