Ack only searches supported files. To search everything, use ack -a, which still ignores version-control directories.
$ echo "test" > file.coffee
$ echo "test" > file.rb
$ ack test
file.rb
1:test
$ ack -a test
file.coffee
1:test
file.rb
1:test
Thanks to @nlsmith