반응형
Notice
Link
목록RMSProp (1)
스택큐힙리스트
Adam optimizer를 직관적으로 이해해보세요.
Adam의 의사 코드에 따르면:나는 일부 코드를 작성했습니다. from matplotlib import pyplot as pltimport numpy as np# np.random.seed(42)num = 100x = np.arange(num).tolist()# The following 3 sets of g_list stand for 3 types of gradient changes:# g_list = np.random.normal(0,1,num) # gradient direction changes frequently in positive and negtive # g_list = x # gradient direction always positive and gradient value becomes larg..
카테고리 없음
2023. 3. 28. 14:07