Sorting 271,568 Files in Bash Based on File Names - linux

Question

I have a collection of 271,568 files I need to sort, all in the same directory. Luckily, they are all conveniently named based on what folder they should be in.
For example, a small portion of the files might look like:
.
├── file.sort.shamwow
├── file.sort.shamwow.abc
├── file.sort.shamwow.example.alsoafile
├── file.sort.shamwow.example.file
├── foo.bar
├── foo.bar.a
├── foo.bar.b
├── foo.lel
├── foo.wow.a.50
└── foo.wow.b
When they are finished being sorted, they should look like:
.
├── file
│   └── sort
│   └── shamwow
│   ├── example
│   │   ├── file.sort.shamwow.example.alsoafile
│   │   └── file.sort.shamwow.example.file
│   ├── file.sort.shamwow
│   └── file.sort.shamwow.abc
└── foo
├── bar
│   ├── foo.bar
│   ├── foo.bar.a
│   └── foo.bar.b
├── foo.lel
└── wow
├── foo.wow.a.50
└── foo.wow.b
So that file foo.wow.a.50 would be placed inside of directory wow that is inside of directory foo, and so on for all the files.
The program I want would sort the files based on where the dots are into directories. However, if there is only one file in that folder (ex. foo/wow/a.50) then it won't create a new folder just for that file.
Right now, my half-functional script looks like:
#!/bin/bash
#organization for gigantic folder
> foo.txt
for f in *; do
d=${f:3}
d=${d%%.*}
d=${d%%.*}
echo $d
if grep -Fxq "$d" foo.txt
then
mkdir -p $d
mv $f $d
else
echo $d >> foo.txt
fi
done
rm foo.txt
But it doesn't really work that well.
Can someone either fix my code, or make their own to sort this mess? Thanks!

Answer 1

Ignoring that your requested output is impossible to represent on a filesystem (requires the same names to refer to both a file and a directory):
#!/bin/bash
# ^^^^- must be bash shebang, must be shell 4.0 or newer
# first pass: count directory references
declare -A refcounts=( )
for f in *; do
f_part=$f
while [[ $f_part = *.* ]]; do
refcounts[$f_part]=$(( ${refcounts[$f_part]} + 1 ))
f_part=${f_part%.*}
done
refcounts[$f_part]=$(( ${refcounts[$f_part]} + 1 ))
done
# second pass: use that information
# ...this is some ugly code, but I don't have the time right now to make it simpler.
for f in *; do
f_part=${f%%.*}
f_rest=${f#*.}
while : "f=$f; f_part=$f_part; f_rest=$f_rest"; do
new_piece=${f_rest%%.*}
[[ $new_piece ]] || break
f_part_next=${f_part}.$new_piece
f_rest_next=${f_rest#"$new_piece"}; f_rest_next=${f_rest_next#.}
if [[ $f_rest = *.* ]] && (( ${refcounts[${f_part_next}]:-0} > 1 )); then
f_part=$f_part_next
f_rest=$f_rest_next
else
break
fi
done
dest="${f_part//"."/"/"}/${f_rest}"
mkdir -p -- "${dest%/*}"
mv -- "$f" "$dest"
done