Furry (the best of) E621 via TBIB almost SFW sampled with metadata

This is FURRY-CENTRIC site rip originated from e621:net imageboard grabbed mostly via tbib:org crossposting:
• TBIB for interval 04.2016-07.2022 post ID 5.000.000 - 11.000.000
• E621 only topmost up to 07.2016 post ID 10.000 - 999.999

**This rips is not intended to be "complete and maximum quality" but rather "representative the best of"
to help anybody to open the furry world while not bumping into yiff (furry hentai, often male/male) and comix stockpiles**
Another reason is neural network training over art images.
There are promising results for specie-specific head classes (dragonhead, ponyhead, Judy Hopps, Nick Wilde, ...), stay tuned.

Manually:
- comic and 4koma, most of line-arts, segmented scans and overtexted covers filtered out
- crops done when large simple or dirty background, occationally gamma correction and other nontrivial improvements made

Also a lot of handjob manual filtering done to avoid obviously unsafe art and throttle most of furry fetishes.
Despite furry is not SFW by definition, (almost) no frontal nudity and evident adult activity left here so R14+ seems applicable.

This release contains:

• 279.736 JPG images
• renamed to contain ID - upto3copyrights ~ upto5speciesorcharacters (upto2artists)
• PNG >> JPG (94% quality) converted, some of them "sampled" to reasonable size / volume
• deduplicated using AntiDupl up to 4% similarity
• splitted / zipped into folders by ID range and also Questionable and eXtra separated (use MaxView or unzip to browse)
.
• additional TSV (tab separated text) metadata
• key parameters for every image (from imageboard and released) spreadsheet capable
• tag-to-image relations - 8.167.078 rows; involve some tool to use
.

More about sampling

1) detected image properties

exiftool -filecreatedate -imagesize -filesize# -filetype -JPEGQualityEstimate -csv -r B:\TBIB\ > exif.txt

2) sophisticatedly used

select 'magick convert "'||sourcefile||'" '||
case when iw/ih between 0.8 and 1.2 and px>4000000 then '-resize 1920x1920^>'
when iw/ih<0.8 and px>5000000 then '-resize 2480x2480^>'
when iw/ih>1.2 and px>6000000 then '-resize 2560x2560^>'
else to[/i]char(null) end||' '||
case when jq>=98 then '-quality 94' else tochar(null) end||' '||
case when filesize/(iwih)>0.7 then '-blur 4' else tochar(null) end||
' "'||replace(sourcefile,'\tbib\','\tbic\')||'"' mm
from exif e
where ( jq between 98 and 100
or (iw/ih between 0.8 and 1.2 and px>4000000)
or (iw/ih<0.8 and px>5000000)
or (iw/ih>1.2 and px>6000000) )
and ((filesize>1600000 and jq>84) or filesize>4000000 or (filesize/(iwih)>0.7) )
order by fpath desc, fname

3) image left untouched when minimal or negative effect of sampling
.

More about metadata
.
TBIBE6212022.tsv
.
FID - imageboard post ID (e621 when < 1000000, tbib when >= 5000000)
for torrent content
FPATH - folder / zip name
FNAME - file name
TORRFSIZE - file size, bytes
TORRISIZE - image size WxH
TORRJQ - JPEG quality
TORRMD5 - checksum
imageboard originated if available
ORIGDT - posting date
ORIGRATE - Safe / Questionable
ORIGISIZE - WxH
ORIGEXT - image type (extension)
ORIGMD5 - checksum
imagemagick:org calculated
TENTR - enthropy (complexity)
TSKEW - skewness (black/white balance)
TSTDDEV - (black/white contrast)
TCOLORS - count of colors
keras-craft text detector calculated
TXSIZE - total text area
TXCNT - number of text pieces
.
TBIBE6212022TAGS.tsv[/b]
.
FID - imageboard post ID
TAG - string tag
TAG_CAT - tag category COPYRIGHT / CHARACTER / SPECIE / ARTIST / GENERAL or UNKNOWN



Information:
No information.