Probably, depending on how you can lay out the physical files that make up the file groups.
If you can put each file group on it’s own hard drive array then definetly as you will see a lot of benefit.
Index should always be in there own filegroup.
Are these tables archived versions of the same table? If so then you might consider a single partitioned table for all the years so that the joins aren’t needed at all.