Why is NEST Large config n_layers not a multiple of 2 ?

[tomschelsen]

As seen here : https://github.com/NVIDIA/NeMo/blame/208e0da28e2ada8da84d8f7ddff8623efe1ff01c/examples/asr/conf/ssl/nest/nest_fast-conformer.yaml#L12

I wondered which benchmark / experiment / profiling procedure lead to this choice, and to the other configs more generally, as this is not covered in the NEST paper. Thanks

[stevehuang52]

Hi @tomschelsen, it's merely to follow our ASR model defaults (e.g. this config), but you can change it to anything you like.