Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error while parsing lot-of-cid.txt #46

Open
lgehr opened this issue Sep 5, 2022 · 8 comments
Open

Error while parsing lot-of-cid.txt #46

lgehr opened this issue Sep 5, 2022 · 8 comments

Comments

@lgehr
Copy link
Collaborator

lgehr commented Sep 5, 2022

Ignoring line 38075908 because of error Expected multicodec protobuf to have Serialization-tag, found Ipld tag (Line: bafibgqegd...)
Ignoring line 69999765 because of error Failed to parse multihash (Line: bafkrjaab2...)
Ignoring line 69999766 because of error Failed to parse multihash (Line: bafkrjaab2...)
Ignoring line 69999767 because of error Failed to parse multihash (Line: bafkrjaab2...)
Ignoring line 69999768 because of error Failed to parse multihash (Line: bafkrjaab2...)
Ignoring line 69999769 because of error Failed to parse multihash (Line: bafkrjaab2...)
Ignoring line 69999770 because of error Failed to parse multihash (Line: bafkrjaab3...)
Ignoring line 69999771 because of error Failed to parse multihash (Line: bafkrjaab3...)
Ignoring line 69999772 because of error Failed to parse multihash (Line: bafkrjaab3...)
Ignoring line 69999773 because of error Failed to parse multihash (Line: bafkrjaab4...)
Ignoring line 69999774 because of error Failed to parse multihash (Line: bafkrjaab4...)
Ignoring line 69999775 because of error Failed to parse multihash (Line: bafkrjaab5...)
Ignoring line 69999776 because of error Failed to parse multihash (Line: bafkrjaab6...)
Ignoring line 69999777 because of error Failed to parse multihash (Line: bafkrjaab6...)
Ignoring line 69999778 because of error Failed to parse multihash (Line: bafkrjaab6...)
Ignoring line 69999779 because of error Failed to parse multihash (Line: bafkrjaab6...)
Ignoring line 69999780 because of error Failed to parse multihash (Line: bafkrjaab7...)
Ignoring line 69999781 because of error Failed to parse multihash (Line: bafkrjaab7...)
Ignoring line 69999782 because of error Failed to parse multihash (Line: bafkrjaab7...)
Ignoring line 69999783 because of error Failed to parse multihash (Line: bafkrjaab7...)
Ignoring line 69999784 because of error Failed to parse multihash (Line: bafkrjaaba...)
Ignoring line 69999785 because of error Failed to parse multihash (Line: bafkrjaabb...)
Ignoring line 69999786 because of error Failed to parse multihash (Line: bafkrjaabb...)
Ignoring line 69999787 because of error Failed to parse multihash (Line: bafkrjaabc...)
Ignoring line 69999788 because of error Failed to parse multihash (Line: bafkrjaabc...)
Ignoring line 69999789 because of error Failed to parse multihash (Line: bafkrjaabc...)
Ignoring line 69999790 because of error Failed to parse multihash (Line: bafkrjaabd...)
Ignoring line 69999791 because of error Failed to parse multihash (Line: bafkrjaabe...)
Ignoring line 69999792 because of error Failed to parse multihash (Line: bafkrjaabf...)
Ignoring line 69999793 because of error Failed to parse multihash (Line: bafkrjaabf...)
Ignoring line 69999794 because of error Failed to parse multihash (Line: bafkrjaabg...)
Ignoring line 69999795 because of error Failed to parse multihash (Line: bafkrjaabh...)
Ignoring line 69999796 because of error Failed to parse multihash (Line: bafkrjaabh...)
Ignoring line 69999797 because of error Failed to parse multihash (Line: bafkrjaabi...)
Ignoring line 69999798 because of error Failed to parse multihash (Line: bafkrjaabi...)
Ignoring line 69999799 because of error Failed to parse multihash (Line: bafkrjaabj...)
Ignoring line 69999800 because of error Failed to parse multihash (Line: bafkrjaabk...)
Ignoring line 69999801 because of error Failed to parse multihash (Line: bafkrjaabk...)
Ignoring line 69999802 because of error Failed to parse multihash (Line: bafkrjaabl...)
Ignoring line 69999803 because of error Failed to parse multihash (Line: bafkrjaabl...)
Ignoring line 69999804 because of error Failed to parse multihash (Line: bafkrjaabl...)
Ignoring line 69999805 because of error Failed to parse multihash (Line: bafkrjaabl...)
Ignoring line 69999806 because of error Failed to parse multihash (Line: bafkrjaabm...)
Ignoring line 69999807 because of error Failed to parse multihash (Line: bafkrjaabm...)
Ignoring line 69999808 because of error Failed to parse multihash (Line: bafkrjaabm...)
Ignoring line 69999809 because of error Failed to parse multihash (Line: bafkrjaabn...)
Ignoring line 69999810 because of error Failed to parse multihash (Line: bafkrjaabo...)
Ignoring line 69999811 because of error Failed to parse multihash (Line: bafkrjaabo...)
Ignoring line 69999812 because of error Failed to parse multihash (Line: bafkrjaabp...)
Ignoring line 69999813 because of error Failed to parse multihash (Line: bafkrjaabp...)
Ignoring line 69999814 because of error Failed to parse multihash (Line: bafkrjaabp...)
Ignoring line 69999815 because of error Failed to parse multihash (Line: bafkrjaabq...)
Ignoring line 69999816 because of error Failed to parse multihash (Line: bafkrjaabq...)
Ignoring line 69999817 because of error Failed to parse multihash (Line: bafkrjaabr...)
Ignoring line 69999818 because of error Failed to parse multihash (Line: bafkrjaabr...)
Ignoring line 69999819 because of error Failed to parse multihash (Line: bafkrjaabr...)
Ignoring line 69999820 because of error Failed to parse multihash (Line: bafkrjaabr...)
Ignoring line 69999821 because of error Failed to parse multihash (Line: bafkrjaabs...)
Ignoring line 69999822 because of error Failed to parse multihash (Line: bafkrjaabs...)
Ignoring line 69999823 because of error Failed to parse multihash (Line: bafkrjaabs...)
Ignoring line 69999824 because of error Failed to parse multihash (Line: bafkrjaabs...)
Ignoring line 69999825 because of error Failed to parse multihash (Line: bafkrjaabs...)
Ignoring line 69999826 because of error Failed to parse multihash (Line: bafkrjaabs...)
Ignoring line 69999827 because of error Failed to parse multihash (Line: bafkrjaabs...)
Ignoring line 69999828 because of error Failed to parse multihash (Line: bafkrjaabt...)
Ignoring line 69999829 because of error Failed to parse multihash (Line: bafkrjaabt...)
Ignoring line 69999830 because of error Failed to parse multihash (Line: bafkrjaabt...)
Ignoring line 69999831 because of error Failed to parse multihash (Line: bafkrjaabt...)
Ignoring line 69999832 because of error Failed to parse multihash (Line: bafkrjaabu...)
Ignoring line 69999833 because of error Failed to parse multihash (Line: bafkrjaabu...)
Ignoring line 69999834 because of error Failed to parse multihash (Line: bafkrjaabu...)
Ignoring line 69999835 because of error Failed to parse multihash (Line: bafkrjaabu...)
Ignoring line 69999836 because of error Failed to parse multihash (Line: bafkrjaabu...)
Ignoring line 69999837 because of error Failed to parse multihash (Line: bafkrjaabv...)
Ignoring line 69999838 because of error Failed to parse multihash (Line: bafkrjaabv...)
Ignoring line 69999839 because of error Failed to parse multihash (Line: bafkrjaabv...)
Ignoring line 69999840 because of error Failed to parse multihash (Line: bafkrjaabw...)
Ignoring line 69999841 because of error Failed to parse multihash (Line: bafkrjaabw...)
Ignoring line 69999842 because of error Failed to parse multihash (Line: bafkrjaabx...)
Ignoring line 69999843 because of error Failed to parse multihash (Line: bafkrjaabx...)
Ignoring line 69999844 because of error Failed to parse multihash (Line: bafkrjaaby...)
Ignoring line 69999845 because of error Failed to parse multihash (Line: bafkrjaaby...)
Ignoring line 69999846 because of error Failed to parse multihash (Line: bafkrjaaby...)
Ignoring line 69999847 because of error Failed to parse multihash (Line: bafkrjaabz...)
Ignoring line 79764308 because of error unknown multicodec (Line: bagpniqivc...)
@lgehr
Copy link
Collaborator Author

lgehr commented Sep 5, 2022

If you test this on your machine i recommend using the release profile because the dev build takes ~30 min to run vs 3 min.

@lgehr
Copy link
Collaborator Author

lgehr commented Sep 5, 2022

The error prone cid`s are:

bafibgqegdbcnm4coqvz75q2nsz7cbph66pkcjt2ixyconxai6k6vrrzjoqzxcak6vwerzq6pdsotjnesms2ra5i3d746kn4tppcgwxlp6twmq
bafkrjaab26minkkj5jnikjq264xlpe3e74l3gcw2ygqberd452yursmk2wg536cuw4ghhcqz2tuuo44otur4u2qkqy4fa4vudrofinh4jpjopd5eedfddlssawz2hji5zp6l7bxfb2wansyvlswazgils554bk6isxmlbxxoxym3opxnfqcyozul462mjfdosd23p3pkqvk4cj6dqaf4o
bafkrjaab2achsqykzu62a2hpvvduru3qybbcteq6pwtzvopokbjhigr5fwucw3uvwhzslkkkm4whdhkhyq7ppebeexvkp5k65mhjpbzlq55irptyvdl37bsgi5x3naqmp7xtx6h3x72o7ygbq7rqelvzmx4ato44ivs7zqt6gknotrxa7n2qynfz2wbfvbk243khw3s4onkcc6455oo7s
bafkrjaab2f22vhh76zx6xe6nvrkmlm63jc4fdjuur3ui5nao5pwv4wcmr4jaz2hx74cllidg4xpxfn6n3kgjg4ttbzwzv2adsefz7wmnufawk3dwbwvblyv6xxkpimzpnxsvh5wwccxhgapij44kofwqkln3ewt76tfhqnhp5gaqhcqnqmazg5uuzzdxbtla43l6psg54m3pqytsc7jio
bafkrjaab2mh4xys4ixsixbzpm6rjxs3bzdmftvves6xircq5bl7o5auj4ikfolutkzdu7wwsq7oxrmnwbggtvuilu35srghb3s5xp6e6jgspeprzigwkihuyu4ts7gpwzyzqo2taptptkey5qnwfxxylfs7djjrav6d6qtageeequmgi7tfazy3rni2qdn7dkp56w2tufhmp2rsz7ulkm
bafkrjaab2np7xzvolawer4mtzcx62qz4pd3c4lxpufwp5mr42yc6bvsbme7rmquhjbad66fd53u7zwkskdkpnymuw4antyid6tlzi7m4qfux36hzf4zaqgzykmbl3d223grtp2jzlldytmwgioygxjbqkquvsoobofzc7bfdzwrepfwxfq2snbnqgey7fa5m6ombthur2dejiqpo6sak4
bafkrjaab3d4uif6iykvudh37mb6xfrsakhrihmrgekiew4qqx7f7cj3ajwkfscgndh2f3rdjeqp7ay4ufqyyqeedqzzgvl4mdwnp7yfbaqhl55cupoffjo4xb4tutqxifdejmvuhg2tagm5pibhms3fyz5m5w6ltf73atqaos5voms7s3chee7exw3dcqfl33vnza7sd3ntmnldurde6c
bafkrjaab3iavdjlqfo3pixgezkvduirh362lvss32qgwtc7y5kh3o5kyqecl5pwqkcglyfqct6azcwxjjcrhj3otxglic7wiaruwbb6et2l4kblkhvsksethgylswce6tgivyf4jcwvghkuz4k4cedulsqjxlbmojndl2degae6y3thchfw3aehdv6v55vrbgsslv6ei4ir2ceqwjjema
bafkrjaab3ypvycvq2uqdmgpkzpto7qbbhbofqfy7cq74t5aufqqcnzfnbfhlrq4wnnk3ymxbwv3oiw3y7rtt6bf4u67oxbyurl7ddcgk4qyrsqmxktamr3vg7djlcdthlzgqr76zhfealenpnkpvrlvi66sne6dhj52keecw6uafevsq6qicvs4ohdsrzbihdw5esuskhqkcyjkvksak4
bafkrjaab4bzys3nlq7vphu57pjtol7s34eugum3hxgtnp5slogmzmkhpvf6oatme2b4pqv3uarymcsjsvy4ns2b4ip7uohnvcsvrc5ssprey44q2sliso2v6jsze4pyzjmtjitu5megkim2kpyqzuk3iebhqmf4k6sjy2ax3xaqjh44v7swqn3xx3vwdb24bjrvo4k7sv637yhbimz5ao
bafkrjaab4qwjjgvv2er5houtu2ruhf5slkznjpod2xbl4fdprax7awcxitufzqmclkrgfgl46tw4vfzsrc6uukycifmsom2ayq65nj7jbm2dwcpzqcflx5a5yvygov7n7pspd6hugvirmfqe4t7af4yz34c7twxz6cbixg5e4o2ckwljykrfqx3idv2ir2p7k7dugxwqv6uz5eumcv7ni
bafkrjaab55oqt4dsklwkensgvt7kkz6b7ltfb6bunhftr6hoqyhyu6o3zpdu4b54plcctckrvr5bttz24r2hepd4h6bbtoy3qhf7b4f2cudfvhgynsj7nipz5i7ptpiqntqcwcv62iiphgnkome7u36yp7urxuqinw56zmf7vpfatyv64756owe3e4csobctraku575qwsrpvsqkoqtjw
bafkrjaab6mobk5bgwc7nyeic3esw4goi6bz47pfvdskio4v67l6kx6hqodbl5b7amfht7lf3re3o6joykjvkuhzzgd2fjqawvyot7tqvpwgkqcnhcm2llrd363r3trmmq7kp2s3ax7pkajmp7sza3gc6tfqyfez2tpmo34wghwxk3vyqfvrojzroxhu6cybi7k222k77s5thntu5x737c
bafkrjaab6sjgmhj3ffpub6g3j6je46qey7hboye67n57jvk6r4huptyjch4djt3ldsan7gdjleqpf752oogq5htvtw6dshvxtp3swpklut4z22oe6jwtgm7t2oy2c6syfexz3b64erlp735b45byg4zjozpaogzrehsz5chl2bk5b53mhfte4rsc27ucndplkkeftk7byifmxfjbgs7xo
bafkrjaab6wy7eslhsndzfwh5zurmfm5youwnaxg3mybjhshelgxa77tl6fwnth22eaghix4ycc2kkngsts5qrcud67dqmzvcqrdpcygpanrrik6qi4azfe3g3tqzxqo4hzlxsfhu2xfggf56duzhda3nig5hayjo7gtjisohnpl5dfc3thgh2qwsisz5y44226bequtu3ikmd4nboctqe
bafkrjaab6z52d4gqjj32cfqscxoiet3ra2fh64i2mrmlpx7fbbp7bqe4jexqwb6c3xsyhdyjwp6nkpqgzpdpjdcb3o7tp2mhuy6d5cdqzlvfguspnmf2mnargvd7w4j777prxejo44vrjgdmwe6qqy55qfsg6yyskme7lory6z5izc45ih6ccmlghuaz3cuavy44rjpyfrqa2byfs3ycc
bafkrjaab7ci6jl5y5rel75t52pxzm2t7ah5h7utp7u3fhv5jtm63jd4rrip66ivu5nprl7nxwu2injcgnvvfcmgejllqnwpzdt3fjj7vb3zc6jx2m6h63kyjsuzp4voolztsl53lprsr2tdnwqffbkjnssr3a6klz2ijxu6lqx6yogfisl5gichadmfnmlywyx7tveda4ucgcwjg4rqik
bafkrjaab7hl7q6bjcg6ss4joboyfdolwuokspuukhhyti4hxtaiquql53tqkcv4yiln54y6wg43txuprir3bizjrcsldw3kiayo2ydw2cszswwmjsqjq4xjwrzf7zbl2i34pcrzke74y3dkuxv4y72lz74dy4lb5eyoiqpzp5umphedbjsccevmdebrlhh6zmjbiobfwh2tw75gevauo4
bafkrjaab7mof6ugrnakqkclnt3td6fbs6bjcl4kti34gmtq4wooy4awsacoiwzpit3geb5oau6vh33t346jl5prhnzk3dg3rjpfkvoqgkan5pi5jkfm7qgcvewif6ofw6rjak44ui6zvg7j6gtybxric7syeorcqortn5d655hu35enwa2vrmrcjqlou7nmt7riwhrscfrfa6r5cpj346
bafkrjaab7xqpev77i27xe6hd5czpaj2ucfrxqifg42u2dhicflwknxphtmfjvihbrxcu3vsicp424p5e5i76bl5icpaqd43dya3a6g3xli4x5c3qnrobvnmwqm2wpvm4sdxmyznpvlox6tik5nff2nmu6qy52gpx3t4c3rim76purab3v64fkwh3cfbhv2lo634hv2l6cpfxb6d5rckoa
bafkrjaaba4tqrq7vyyz4apkg7w6mpfk7kyurask6p3iqpsrgkvsueif2nxpf5xtc7szrjglcbshkxpkom4oua3ygxgjkfr7wbuu53h6cpfrynetgr4uuyew5f24ehi23timslnggihspt67gzhxxhvmloqljn2chilqqdxsuxxemjguwlppefqt7qdp3s75rfe5mzmoorefwcqno3lnps
bafkrjaabb2yn636ylvryxu43wrzurcaj4vke2sc3mqxs56rq3uvarbz6bckwikd4fk77nydhodxw3jdhlytwpyf2fq7d2melh6boipdx4cdp2asqgdomwxnmdlqfrncj4oq5kaxcbuti3jzkqw3ag3hbtloepiajpfag6nvkxxyb4r7k7u7jlmlfb7vbsgsknk2crbkqxx5li66flvr46
bafkrjaabbuuceyxbwi76zzlk4jetnpgofo65budw4d3nifxvuqqtuozja2um5chichubkd7ffkxuubm3lz4nidjqlpb6gso3qeh52gy4dpfyyzq7twpxudh5cmfy7myierajkcsa6c32k7gjbitukqdliqjirbpkwfnp4r7qww3wc6xftrfqrpsscvmwfgdty6pv7pjqogvxjstvyobfu
bafkrjaabc4stoocne2cn4sx3tpund4w6zrne7nex6ifod5wq3qkqh522wm7dlfnczg2pgqqpeq2wfvo4tlkrhq3czvnlja63i6szplfcgy3yjpux6xoc673cf77kfjpohzyy6usx6trqt64b4bf7jkopjfxwrobxcwmrp4sdsnr6my6qsgwbk2et6awgf2pgavp6dvnupojvsgt4ev6ve
bafkrjaabchblsjftzgiwxin6rt5zmxkoj7npvjsezwnsfp2i6pyswmdbmb3hxhiomqnyydk44udphqgwwyhyuqzvjpapk67ehin2hc5dp2usgbksoruse7labhs3qjptndhjneuorq3oivsgdt7ab6mlvqywyx3kf3ianzf67kjgdljczd4ydbk2one5wjuqriwfnqxztgx3hq4a57c4k
bafkrjaabcjlz2mc2qkoo6x6drr2xysbqm6b3lepso7jlawvs2kyc3gj4i3oi6dxvryb2ou22d3fedcurkykyi34amo7x4ishflnqfdanthjwewmq7gmmvgxv2mj2ixici53u6nwj35jdlgjdt3vcmirdp6ysn3446tx4fz6fr2smw6fl7p7kq7e57mcbh6uclrhcfd6e5ub3ldriwhsss
bafkrjaabdpwrrirar3j7bnw5a4lh7bmt26i7izhfmbavd2vu25qecne3wm3p65otp63q47kbdul56pbp5pxeyelr7f2ub4wrky3bct5oxmti2ay75shl3uumgfsnxn44ghvvj4euittyw6thpri3y5dgmcchqdcn4bbqh452kksghko32q3p7j73ozhugi7s76qtl7dmnaohiodzxatig
bafkrjaabe7uygecw5t4iutgpzxscdshoaffqtjbuj7ir4okn3h2zzvgt3r3g3hwlli6xwkejyxc2wkq2zzsl3v3iz6klofiqcm2s5azw3mbytst7svrkqgmsoxqk6pysp5qoto2ucr4ct4cfc655i2qthtiuokmux2abtmqofqlousjedsqab642rh5u7vdbwtcch3bxs5p2b3bhhr27o
bafkrjaabfl6x4isgu3kukboqirav7x3mq736zqpkq2dpclomeyh2ikwjuzxoiq6y52sj5nv6qc5xacrqn2i3azup5l5uk4dxqhq5f7kizkepih5vrpdbux2gd46gx7xj37r6xwykfjxxi36mffb47iomsxlubsjj2kzagsql4uyxokqva5hr72yy7ikprzfqisf7y6p3dioeaiiuhitts
bafkrjaabfwmyhcd63ae45ryqpc42bxj6c7rirddgvv6x6lzvlxw66ej33e4zwh2b24r7lz2mtxqdp5yncvxh7t25jtlqmru7ver2aykqru5fgger46xuks44efhscauuw5k4k266wuqzbl3dhw3dqps6b6bnrofkf42pvkmdsgjrimya5d2tdawvkdgqdjjzqjdn6rzspw6hyuqndr6sq
bafkrjaabgmzb2cbcmxkwus3ppxi6dand7mrdbf2r4o5cdvskvj4bn7k5qcgwkufp7hjdu5xziudxzggxv442musjafvfpl7kmo34bzxxu4tm33pd6ckxvr5cghd5ur5pmzksd2cqvf2nrfkhsgntiiydpqouqvn4ry5w5cnityr3qcytbyucioku7muq2iv7slfptbakztmx7qmitzazi
bafkrjaabhvsmpiwhkjohkvkcqn2e3m4u45lsur4cpbvhav5vqatio655y72riz6pzwprynq2cjd4kfi3qlqkyusxtzjbjreyym2lox45gso3setgoxx74zidx4qrsnl2pv75zvorcdy4wdxrjih2jyctluhapqq6fmqz7lprxpo3h7oh4efhdup7emenkuljtlrugllfsyfi4d2s2h6x2
bafkrjaabhw7pszxha3a2x7ip7jdhzxteyfyweoaryb6gvp3a4wvf6t2yecvmhi65xppliat7vsvtudwsmteoexcqjjqccahjtvfqdipzz7j4ibjtji4us6rkus24hir7ecwmd3kquti25uivumk3chmd5xhjhmuibci65t5mdmhzltungh3fgbxdzbamp36xndvxbm6eqpt5vxkqrsbjs
bafkrjaabilzuiivhvojtftqjqye4igm5gpymlvwsyyvxeysbr76vwix75vqq4h3wgxw6ik5eo4ysbe72ddxk5j764nbnvqckvwcftcuvocanb6dktcryja4ah2kv2cwrbdggdpuhwppqzw5txeqbj6j4eyxmkdgf6ztpmo5wbdo6v2puobmr7b236euiiy3omikshlm4nmtgzxelotln6
bafkrjaabinyuktxepzw75rju3nr562by5nrbts4bqcjlebz3nurv3ft4ujvbmbuyi3x6iorpjw4emu7amk3k52s5fptacuj3fgdez73dmt2cwom2lcmafcv7p5efd7hki7eraxan4j63l4ny5tepvxsbtx6u273fjbe25jvkva5ckus4vlnkhntvgxis7yjwx67kkftn3fgyerwdjrzzk
bafkrjaabjww267stgmqmpy45e7dy6wiamcvts3uz66jue3hq7b6yknxgkyv46z6a7y5btfsox2sofpfybzrpxspmamdgokcopzwrqcrvgqw5bysgnsl27gygc2z4vc5jrk6rgjunuqqlczwoypnuzzu7k3zhdm4g65qkqfpres7dgzefrxkyyak3amaze6pmobdblwine52pe522unkay
bafkrjaabkpwwrlk5snzer2awqcjow56ftq7mfnpletwkwefds4slf32oddtk5jhg5mtgopq74oos3gk4rvkcv6bi3t4mbphnhuv5vw7df236tfsl3vbivldqwody5ugbdggeaheklej6zt7dcvxwli3lt3kfmeerts4kda2ax66u65zuemgzr6x4c7mc23u3yann2f3rr2qiv5ro2vjl4
bafkrjaabkqypcu3evxn7se7leoeolovlg6dhlcn2tqfytcip5ackhpnaci4bjrkyis6rgec3rcji6t6mgdlwkj7xmhymf3w5kziip5f4bp24jppf6jcmlxq3ds3dia6k56twxlknpzgfpztc627zhk6op7x2qca7stsfquuui6crityxffsvgrvpsehjf7o5fnxv5pdf6joohsec2ae2e
bafkrjaablosdvvajaf7qnwyssdideyedm2r6y6z2tatmy2f2hodjgoyzpfo5yjhylwjkt3l4vd3plyujth2jfjizaa2lw4hpfmtdg4i6wh3ozepetwnyitwrppty6dwt72t6cnifrnwcfehmv7ndadrabz7ds4djdg42egcyimqjlwepynuwux43qs335o5vdlzmrrmvby2y2pj3vqepi
bafkrjaablosp7kdkky23ox4shwurin2mbdmg2zlkihszrb5e5hd7b3z7sw2uaw6skjtwaux2tf63u2kwiecilji6j7ws3l74mkij6bduwxtwuzcdjsgopdoe6xcur5gaf2brad3awxv75m3ucunlxwiqlq54eyw6gheyba2nnahfzotezgsngdq2oxelndkudmdrdvxjmabdiw7nitke6
bafkrjaablqn34rauui3dma5alscs7spwpsyuyi5rualeu6wtoh3pxqj5zwp5rf6m7yuqorskruvogv53xcnunh3vhwysgus4ipvjfyxz3cjamlhq3hb6xmyxgnlelrgwn6be2rxgznc6sntdb6tswgf7ufek2zo4oidzjpphafcnjbx5vil6bo57cqqpzn4ixgp7nrgxwczrd75s5cq3w
bafkrjaablzx34djyymore6itgmjt7c2mwayu5wq2gbxysvfpc7iikadz2govgjduu74mbnaeji66y67dedbnvuiujwe4hojqnesxcufcf7xn5dgd4j7gu2wop3wutycwlegp55do6ccdyrs7q3rgqqfujhkr3abizfeswds3dku5ebvjz2jdgynamllnqh4qpg7z5txlndx5f57epphgw
bafkrjaabmqongcmxpzpw7ue26n4gn62va5c7ny2vdpmhxiujfoqv7jsrocv7rtfpoqlduwnuuec7jh2s7uxyasssqxb3faprmmo4anxk2seljfiywhydfs6zyhk4daonwhssnd2nkwcsfhbtaq5oilb7lbzi2wgdmxrcvcdq3lzk2yqlljv4ber5wantb5qskrfqivf6ovoodiiryi2ho
bafkrjaabmqscs2f5g7ziuvkvmunc74yad6rwsgjaninx7arheion5ngzyfgj2qoveg53m4vo5wuac2uo2ft2ewovxlcksdrlnzszzbrvz3kdm6xqhssze4ci47lou4ulhkbspoki3urygcgcwuvti34fo3jxkzehahk2vavm5urxy7bzt6j4veybrkzq7joxtzs23qz5yobivygx5dvwm
bafkrjaabmtp5enxurs7kzjq3tvdopvrfufa2eiywblbuxjht3ehdjmf5era4ywet5zipfah7o4du2x5s5km26byne5hdkmirx6eojsxn3gmzknvmnkefupoxsfiheytbaajzv3f4d3swjtfzovyzeeeed6oq4jtadwznso5bszerk3t64tjeo3sgk5eq6wglxha6jkixzajlsl52akxxy
bafkrjaabn6ytfgvfzk226od6pazil6j7scurcbht7drtjbb32xb4hzvjlli7smqlquwxclrcsxdsebfobcat3ij7t2wx7gtt6ytgklz33t5cfgdnlx7zy636sud7uufbrfjyxegsfqnfk3aarab2rw2i6xhrcgakywyaeb2sdui254oxat4jl3cmumx46mso4old5x4elymexma4247bm
bafkrjaabojsihd337m3347sp5vhx2iwpprvm3seivdblxdybeqeaqk4pjvesocw5zrah356aur3m6sskneb53ehcb5rn6odfocaqf2fgjw2lv5plwjximp7cwrpffrntldmv25yblaxjttpaxukw4aymshbhec7wpxme4h3qqe5uxdqinlskpvlex2z7246r37z4lfcks7fxwaxb3tph6
bafkrjaabour3dl5gf3kabnpxwk2uakharuuthnt3jkj4c4pffonuy5kylyuv2qkw2agpl3em7pq5kyjrifwdua6il6tcwzlwt4r3ayykbsvdfewea34cc2umepeat72ik46jm43ajvl57wbrmn6nityb4yv4gyqheeto2g3nrqhuwz3i3rnocymlqaihf4xy6adfjsh3c22h6qgm6372o
bafkrjaabpbp3t2qjnbikvwi4rpeowgoeqynfzkm6dilyxltflgrm3tzjcq6ctdbqimlsfaiwe5afvrr3wqxnpmddciyepclosr4ysq4whpo456jsurc3bopsu7b3zxw6t657kgepeho7qlihn7cz44pauvmzufywytnilue4lmwnblvu2rk6wetndc3ohzogjkebtafzalronuyvitx4m
bafkrjaabpcvnsi4abi7co5reyh4yr77fkh2g4jcki4yu7sdnos6r5nw6vxluw42krnvaw7kbb7fejnpgazrx4gb2hmlpixzr6mx3wczqvt3s5bs7rceomzb2nritbqqdyjypwsojcnraacpjjwqfnooruw6ilcl45alryad5bn36ztctg4bwvehgngc772a2x72gg2wk36j254ihrkvts
bafkrjaabpznhocdmi4dvt6fmps7uomby2et4ukvtjifvtsma3mssugvixjaeps7e7pyeiqsaqmkoq23wdqgpfregmftobg3b6riq7jh65rq276hvrnn4guzl5phxilrmjotg54d7ewyfjit4mttfd6qmt3cric4ishtxjbuxluzbizomu3nlx33zbdz4pjhr3zs2bsxyhaiqr37janwgy
bafkrjaabqj3e7sdsc33njrtbfyj5yhxzoso5qnujzrodx2hmiqqp3bhcekakcq7uqw7s2del4nhecjokjbvcklzfwwy2aohit6rigb74fwbh6tnvzve5pgxm6ceuu4l45lnzoapkde2dw7yxc5h4av7epjqe67g3loajq7kvqgfxp5e3ly7pyiqw4mp7zig73bzmdngqrchgdmzw7xmly
bafkrjaabqmhs326kalqqyxvcidxp2fqwoilsv6uy7pgbjcxz42lesas7lwkorhg3m6prdwt237flrwfvcntv4dqtmgecfwogytqmk2yirzzsj3ml4wdygqu4fwloayvalkelk43lomrn45loumlwyvff6lqisv7rk5vdas5x6kdff5z63jibiqott2egvtq6tdkd6dh23bpndkh2c5fl4
bafkrjaabrbgcb4xr5enczavftcdhf25hl3zs6ta3bighqsa26lrh4cyo6d62jufsyylab5f3erzk2nkwyd7l3xndia73jr57bkdgbyowtszkb3ch3wg3p4rt24s57ateb3glxftcech2efezlnua5hmepono36wcistbica7k6ua7hslto3y73fidor3sstbf6su7rplhd2d2v4v6fnua
bafkrjaabrc5tqnqyzgdfbkx6md2eostu2zm7x2znklb5x2f3z642bjr4jyro7tgiy3gop5gcbyvltmnviclper36ulb7azpkip23f6wjf3hli5rdcdogbnxcwok33ciup5qgucktp2wxkkzjvlgykmafa565bghj6lw64xpqfi6mdrmxquzmntci2l5jevcmhoh7cidxcyumtcb6boejs
bafkrjaabrnfvreb4js4x24cqtx7pj3zv7ffa2kgmrrvvlzql5mcmf2n7bipaichk2gtqgpva4hyjpvlbghj7tuw4asjcbbzepuvxug72zhrtwgglckgsieyksjwdos5loiu3jdehnnj2qa67modkjwrkxj63ypqmde2qmkj55je6yndnqzqwvcw6ihx763zkc3frher6vily72ihapwvw
bafkrjaabrvx7b25udj7ijxthjgv3crnpsgxjhccknj7przgjswcj6v7s4it5byv6x6h4vzwwlu6lixiicpojwzcgrxh6gjccm5nnk2lvuwwvzp2jfywq644xe6633xhzmneo6yxs2douoksco6w7q6zu3lsa4sadqwscsnni57ioozcb5okgfviswtteoke4cllsk25wfkmck35fimrpy
bafkrjaabs2onqjlgad7hgxy62avnhtjlzlzbid5nvusynr27chman2pcwgnkvqfsyp3hxc3al6q3gh2nq55cfmylnr7quss3nftz5nlbwbhdaggn5r3vvksphxndw6pntngzz2xp5rvtfaz7vhzbxokfttadhqc7rpzw5hqbpt6ozad72fnhtsmubwg2fmqn5tdhvt2izxob4yashpy3q
bafkrjaabs3bw6qbv7x3t7cafketctededzfuk4pmvgfun7vydq224mxq7vjxq7c5cnl7cjp73swqag23cvvhiyr77rp756a5w2xho3qsgdlupyh6lpf6q5xu44widqhuueg5gikmmr7yg3i6a2faly5dtld4y3qgmknqdoekwlamrhk6zcrp2smdjc7wbvbeclvshjhppeuipuuchn2ru
bafkrjaabs5qy43peeiio4uzm4p6y623g5xfm72xxmidjvna5h27j4p3exoa4b4wy3ggrtivavkpcd6f4l5hiqeo2ahpcwfkfoawawnejnvoz6bna6u3rwnwbw77n3pewvwhxre6l764e5hotqdhamdt2nlwlvvuhj2bfbfqigdr5kttgidifncicvj52mhp5yrgndi5c6vxx2tjzrjva4
bafkrjaabs6ufivhughjp7ir5gwtxfvntr6jvz3dwxytmcla4g42vypmhhtank76lk2pcina36tdjmyiukg5xjogx2yueeidytvgfeaxjoqm7oh4ib3ctbrxigwn46zh6rc6fecb7voj5xdyisrul47n66mdzgnz33ogutte6ym746gin4myw6fghpbfspvk37abeklxwqam7qe7gnjfby
bafkrjaabsfgydvyc4tg2nwl7mbmseio2kukoevaxnypkocgfvqrtgpqa6por3ghridlyyhd324hqsm7e36v7fyx3mpkkxsb5uocrlvi36tnb746il2wkbqgao4apkxsrzsfl4jwv2x55yr6v3czwc6k6rpqt2iumwagkplmmo6u2ax4knixeemjy72uhz7kyokpjbazayikehzvpsqdha
bafkrjaabspxi3ihqmcxor6bn7kcproo3kdu2eh62ivivh3uh3tei64rrv6fv5se5is4a6v2j3plvoy5zpvxwuvny7gf6ea3rdufuwj5rt3ki3p76sxowtyys5baxefyvcr4he2lkah7nj33m2fryuzz2y7il2lszz64wthxaag3r4gwlowx5yo65tsmv5jt46zvskq6353i7jqlbzx7i2
bafkrjaabsveesdqkexsnplmar7t3xx3a5msbku3pk5wuhitcpgzlcinet762mprvga4podf7v6oq4ogmyanznar4hmwtuzfxvg2drowcq47uoyzwq2hhgm4lxudsclyb5sg3yhq2jm2gk4sgg5d4wyib7lguinio6ia2v5lsugbkr4zxog5jqeyqtp7x6qu4gpkxg62zmgexxua4s36dk
bafkrjaabtdzdj2uipqf44e5kps26p7vgsr3d27hkfyanttdqvxrcbnfdwhh2ljq62dbi3hjhth26gw3ydor6e72dtq3oyifltuoaivx2yjygabqvvwdim6z353n3jogibmr4tmtzyief3tr2fjilywepqwelvniuncccpb4snovu5irarg2p53u6dfaw6svclra2agaatvphupcsl2hye
bafkrjaabtfbsabq2w5ztdefvoqzgol5qf7q5bongd3c5ccblhvubottraocci4helnupfawxmnqoscn3naiw22nfms2ionxdntonfsxwmb4fmhwxk55efguwvmjvmba3geu5eakho3ck6xdfgfosxogwu2uabe3uhlv3y3g24v6rihbfdmhgeullx7bzmv4ihtlfqaiayyedwprlhgjvu
bafkrjaabtns3a3b5l6zmlhcftagzdjh5tztyjvtr6gbfvb5szwwoegoj3cnixkwh3xsfpajcfz3oua2ax5qykjimirlvlqou34l2ank5jeqt3k7yfqt43ddfzvixobmtscbnfhfqzdwnsrnbz4cvo72m5zdbhkbqgtlkhvb6kzw26ctd2qwvvvhth3axal5pwsrkdy4b7zbf2kcei7aqs
bafkrjaabttusp7tdukbbfqfy2ga77myc2i3m5wve7p3w7jpwmy3zke6gwnvxydzwloflj4c5nga3yzzw2nsghtqe3uvkhy2dy5swuoejrmmv6fezvkjwx4zxfkhwqx7yiyljnikqdc2lx5xwfr7gm5qn7ze4lpzq6v3isghmgbteuq4mnlw4jgzt4qoltlyprj73dly6mvozbov573xm4
bafkrjaabuat5xjpar5yrpg3sicloxw6z5hkkw62j6i7ckzmimmekd6g4q5a2xagncif5hb4xx7pgakodladw52lwogudgwgl5c3n3zctlgozifjwzk3q6umdxowyqxwj3e5jw7lib22abxgem2mpfunb23schct2cllclb7xylyvi37h2e6rxdo7lmtem2muph7ieb3dfxxbolrpzml5y
bafkrjaabulevb72acnnyftyanljthege6itynyw6wra6ky2swtqxxhbmwrz42lgnuquh3vmvsmqziacosbeh4gv3bdk5zd76fvhiro6azfki3i3krkctubwr5u7b4pyemfzhnny7jduj5hh3klppruewcpearhdzo2ci7tqel2mcp2s2az75qdygsv6vzdtkmslsbzy4e2bj3plbaulhk
bafkrjaabur3wnqen6uqhvtuwgtfddqg6v6o3t4qtozy47xiiugx5xaotdvsla2sbqi5fi3ncfyx2hzdsiwh6bmphv5urepvyc2v427r4uf4wie2zfhe7kqyv6mocljevfoymv247mtrfcp5rupeerwyyflkw2s34v2oev5a7mk4624xdzo7ycf3zmc2rzuol3gv4ddv3y73hsvtmlgwgm
bafkrjaabuwve6ttsvmnefjksk3rjc2j4xxqepc37xjaiedpjnn5jge6abtpwo275uutsbk4nxfwyla4iulaaw2w6wxvpfzymef5xrrzlppiqjkmj7n7sfhjo522iwcguuv2ymf4hmvhl2mvcy4a3cgkef2mvmogmoxytrwtig6sqmxmf5vg3tuku2chor2yethwh7gbunrq2ta5xfwfp2
bafkrjaabuxbhmsvdec7oj3shjzcfd5qet77t3j2vasfccyelj2gc7ii3drgrcbcjoolbiu6z2m63kjlvoh45e2vjhakwoxpxbpur62xfm5fbinlipwj5mejcon7cdlvmo2qmzjmffmk3ea2soe2vnpn2robhyrppsyuv5p4zaq24qjgc5ltpjwfcujroykoi5brn5lgg5hfmfw7jjk24i
bafkrjaabv4yykzkfqnpjlr2vgqx4ugocz5nklosz3rrvbmoieqriwkzwlnyd4d5gbwnc25ezq6vi2mwudklhanxi5kozw77rdow3lopubx7f7i3254ay2btpivjxrvsovfxkpm5xeocrax2lr3grsxyxzoau5v7qklbgeq3osptpzsjyx3ea7rmkuveephpa6snys3ifqkg26na2q3mvg
bafkrjaabvpgwyqflkork5kcubgtdbofqyyo5noioxdb2eajy6h3u3xhxvnxqqdr56dqx7p5ylgu5s63dhxgegwdwamkvfsel7pmsffqhqi2b6jkuanxbpj5d3f32ars3bov3kci7rmuqch7npiet2rmgj5utkskx6ucgw5u37ocs3sfrn2f6l5bwpny6hkvkdnyrmux7uqgkvpk5owc26
bafkrjaabvuwzyzwwgujot24texn3gdhkjt2oy6b4rp6zrbzrjkk322kw7v7renxd63sb6lxlji5mkvplbaphb6ccurepo74chocnqtjlau7t7cllfzi26cv43njowjll6w2gbmnaxweqxq7izlbmujw3nwbb4734uzul37olduc447yy4vkvysmqvakngasg7kdboqljqacwbalzl5g7o
bafkrjaabwsyby5m52ns2oz6a2qtbn2jgoobe64rnktwwgrdke4sus4ku22qzchlrubqcgwj24pld66b6ec7npdeo4lloh3epzhlmurdf7hopz66nx6hnecrdw72dmmvg6ndwlyxvwsz6bxzeqsk3aztnros6jax6twzmkduz7udzyosdegzxefl7ghx4vda22z3byyix2knmc573mj7hy
bafkrjaabwtu2phnslnji2dyn37p2h64zsxvip2hk6ox6erfmenl3ede5jzb22bdv3dzbs4sj654ekv3ozz2yjxhfms4zytkeyzl5mwaqiqualfhg4mzsh2pvsecmvhza5gjcsujynychhrvye37ubufoe43aa5odjlj6i32rigjap46ibbjmwdi5ylgjg2nnydbbdk3knu7zbcsj75ezg
bafkrjaabxq3ymjerz3jzs3dsrcmwngipjm2ftdfvex3ybsz6eboasa4ekkipe3ps6leo6pg4hgzllufebwi5hkddeer66azuxbbefga6xcstg4od2lzonnguwcqhxzunjryaujtbmswojvfhlgwy4twb56dmf7szk6hu5erw4vp3vzakaqhr57dlhersb5qt7uu5aukhedjlpmutvegj6
bafkrjaabxyta7sqzwcfwunl4zdxsplz37utijxqydv7bprleauutz2ukmoedobajglkrrogulseaybisqjydtmt6ifvexn5jd2hmlkgcqhonqg3cfmmltdl3xxd3blfptgiadk6qnfdygfevdmughdsvgc3qmtdkzmg65pma4inurciecgqiwjez62sy4zaa6jd3pibcxttbx4tv4umna
bafkrjaabyaexwlkfqy2nmcavj7pean4egnc2eozub7b5kfz5el44dveegpkt3ebj47awjbm25wksxpuz7x5jqpcegn2vg4i4mswvjp4t276jgj5vpcrvx4z3or63xj2r4aj2ie76kh7jaicfdholvv4vk7aecwn6v7wyywv3o75klemp7ksx25ursgydvjcnqjg5dc7lh33a7g4fv5hgu
bafkrjaabylpfivacrci6wgruxbt5a2mclmxanv6yzdc3ga2lxmccukl6z7nxyndyfexexku353rc2epxwqbvapzfff3u76wzbv322gdt7bu6hqk6qo4o4dij7yfp562kj5ljiko7dtb56eajka74raxouf7bcap34o4l4kbqj4gnutglzylsulhntybhftlwnvumxvdusjd2owkbk2ypq
bafkrjaabyxxol6kv46bk4dbysrf5t6uggtc6dy7f6j3bj7ozjgt5qngdd445puhypnqr6fnxgoz6gyw4bufgs7ddif66jezeluvqdkt7qzm3ffae3d2hutstviilxd6zdw3ij77pjcxcnxdhvmuroigjbk5xxtt4hunxteklmfoiztnw7xsbsovetr3pulzgrbyy63m36doreep7fqqjo
bafkrjaabztqgwedqpisnzrn6qyzyxf6chlz463f2dp2g6z4oyih7oy2fcvtgf2hpfojril3hxwn76tcigscopf4jo6nmdyxa7ysracnrnrvsegamiukjk3w3svagnp2b6ssngbntorcbbzp2h2l6ol7df7ea3qsb6bfg2c43mxtqcrpbre3l4nymfrc3b7pffe7iyy6lo7sh4yjmgpgl2
bagpniqivcqm2hr7jtgbnrjlgn3w3cncfnbefr4ojou

@mrd0ll4r
Copy link
Member

mrd0ll4r commented Sep 5, 2022

There is a tool at https://cid.ipfs.tech/, which parses most of these.
It seems like the first one really has "protobuf" as multicodec. The ones in between are SHA3-512, which we should be able to parse somehow.
The last line really seems to be invalid.

@mrd0ll4r
Copy link
Member

mrd0ll4r commented Sep 5, 2022

I'm not sure how we should handle the "protobuf" case. Maybe we really should ignore it, like we're doing now. I have no clue what these are for, I hope it's not many.

@lgehr
Copy link
Collaborator Author

lgehr commented Sep 5, 2022

I started from below and also found the last one to be invalid.
Cid::try_from(line) seems to fail on the second last line

@mrd0ll4r
Copy link
Member

mrd0ll4r commented Sep 5, 2022

I wonder if the issue is the size limitation of the Multihash crate (see here)?
If you debug-print the error (see comment on the PR), and add more .context() in some places, we should maybe be able to figure out what's going on.

If this is a problem with the multihash crate, so be it. We'll more forward with the PR for now, and maybe rewrite some stuff later, but I don't want to drag this out forever :)

@lgehr
Copy link
Collaborator Author

lgehr commented Sep 5, 2022

I already added context and looked at the backtrace and came to the conclusion that the error is in the cid crate. I did not dig deeper.

@mrd0ll4r
Copy link
Member

mrd0ll4r commented Sep 8, 2022

We could try using a larger CidGeneric. If the SHA3 problems really are about digest size, this should fix those.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants