深度神经网络有多少隐藏层

How many hidden layers are there in a Deep Neural Network

谁能告诉我"usually"深度神经网络有多少层?多深才够深?

据我所知,隐藏层的具体数目还很难说。但是谁能告诉我,比如一些例子,研究人员、开发人员在他们的深度学习项目中会使用多少个隐藏层?

非常感谢。

这完全取决于您尝试建模的问题。您拥有的层越多,训练网络就越困难(需要更多的计算能力)。然而,层越深,它能解决的问题就越复杂。

Geoffrey Hinton 在他的 tutorial 中写道:

How many lines of code should an AI program use and how long should each line be? – This is obviously a silly question.

• Deep belief nets give the creator a lot of freedom.

– How best to make use of that freedom depends on the task.

– With enough narrow layers we can model any distribution over binary vectors (Sutskever & Hinton, 2007)

• If freedom scares you, stick to convex optimization of shallow models that are obviously inadequate for doing Artificial Intelligence.

据我所知,层数通常不是很大。 Here2014 年 ImageNet 大规模视觉识别挑战赛)例如google 团队使用了 22 层的网。