# Git push rejected **URL:** \ **Category:** šŸ¤—Datasets\ **Created:** [February 7, 2023, 3:09am UTC](https://discuss.huggingface.co/t/git-push-rejected/31227 "2023-02-07T03:09:35Z")\ **Posts on this page:** 20\ **Page:** 1
**Author:** ![anjalyjayakrishnan](https://avatars.discourse-cdn.com/v4/letter/a/b782af/32.png) [@anjalyjayakrishnan](https://discuss.huggingface.co/u/anjalyjayakrishnan)\ **Post date:** [February 7, 2023, 3:09am UTC](https://discuss.huggingface.co/t/git-push-rejected/31227/1 "2023-02-07T03:09:35Z")
Hi, I am trying to create an Audio dataset. Not able to push data to my repository. Getting error like as shown below. ```auto Uploading LFS objects: 100% (23938/23938), 28 GB | 0 B/s, done. Enumerating objects: 25039, done. Counting objects: 100% (25039/25039), done. Delta compression using up to 32 threads Compressing objects: 100% (24983/24983), done. Writing objects: 100% (25038/25038), 11.29 MiB | 297.00 KiB/s, done. Total 25038 (delta 67), reused 24963 (delta 46), pack-reused 0 remote: Resolving deltas: 100% (67/67), done. remote: Scanning LFS files for validity... remote: KeyError: 'data' To https://huggingface.co/datasets/my_dataset ! [remote rejected] main -> main (pre-receive hook declined) ``` Audio files and csvs are within ā€˜dataā€™ folder. Please help me to resolve this. ---
**Author:** ![radames](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/radames/32/28246_2.png) [@radames](https://discuss.huggingface.co/u/radames)\ **Post date:** [February 7, 2023, 4:28am UTC](https://discuss.huggingface.co/t/git-push-rejected/31227/2 "2023-02-07T04:28:15Z")
hi @anjalyjayakrishnan , It looks like youā€™re trying to push to `https://huggingface.co/datasets/my_dataset` ? Could you please share your `.git/config` inside your repo, if it does not contain any confidential tokens? You should see something similar to this ```auto [core] repositoryformatversion = 0 filemode = true bare = false logallrefupdates = true ignorecase = true precomposeunicode = true [remote "origin"] url = https://huggingface.co/datasets/radames/test fetch = +refs/heads/*:refs/remotes/origin/* [branch "main"] remote = origin merge = refs/heads/main [lfs] repositoryformatversion = 0 [lfs "https://huggingface.co/datasets/radames/test.git/info/lfs"] locksverify = false access = basic ``` ---
**Author:** ![anjalyjayakrishnan](https://avatars.discourse-cdn.com/v4/letter/a/b782af/32.png) [@anjalyjayakrishnan](https://discuss.huggingface.co/u/anjalyjayakrishnan)\ **Post date:** [February 7, 2023, 5:53am UTC](https://discuss.huggingface.co/t/git-push-rejected/31227/3 "2023-02-07T05:53:19Z")
Hi @radames , Thanks for your time! Here is my .git/config content. ```auto [core] repositoryformatversion = 0 filemode = true bare = false logallrefupdates = true [remote "origin"] url = https://huggingface.co/datasets/bridgeconn/snow_mountain fetch = +refs/heads/*:refs/remotes/origin/* [branch "main"] remote = origin merge = refs/heads/main [lfs "customtransfer.multipart"] path = huggingface-cli args = lfs-multipart-upload [credential] helper = store [lfs "https://huggingface.co/datasets/bridgeconn/snow_mountain.git/info/lfs"] locksverify = false access = basic [pull] rebase = false ``` ---
**Author:** ![radames](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/radames/32/28246_2.png) [@radames](https://discuss.huggingface.co/u/radames)\ **Post date:** [February 7, 2023, 6:14am UTC](https://discuss.huggingface.co/t/git-push-rejected/31227/4 "2023-02-07T06:14:02Z")
hi, it seems all right on your git/config. Do you have more context on the original error? maybe more lines about why your push was rejected? Also noticed here [.gitattributes Ā· bridgeconn/snow\_mountain at main](https://huggingface.co/datasets/bridgeconn/snow_mountain/blob/main/.gitattributes) that `csv` files are not on your list, do you have large `csv` files \> 10MB ? if thatā€™s the case you have to use `lfs` to track them ```auto git lfs track "*.csv" git add *.csv git commit ``` ---
**Author:** ![anjalyjayakrishnan](https://avatars.discourse-cdn.com/v4/letter/a/b782af/32.png) [@anjalyjayakrishnan](https://discuss.huggingface.co/u/anjalyjayakrishnan)\ **Post date:** [February 7, 2023, 7:11am UTC](https://discuss.huggingface.co/t/git-push-rejected/31227/5 "2023-02-07T07:11:06Z")
@radames , My csvs are of \< 10MB only. My ā€˜dataā€™ folder is of size 27GB. It has audios and csvs. This is what i gets while doing git push ```auto git push origin main Uploading LFS objects: 100% (23938/23938), 28 GB | 0 B/s, done. Enumerating objects: 25048, done. Counting objects: 100% (25047/25047), done. Delta compression using up to 32 threads Compressing objects: 100% (24989/24989), done. Writing objects: 100% (25044/25044), 11.23 MiB | 295.00 KiB/s, done. Total 25044 (delta 72), reused 24963 (delta 46), pack-reused 0 remote: Resolving deltas: 100% (72/72), completed with 1 local object. remote: Scanning LFS files for validity... remote: KeyError: 'data' To https://huggingface.co/datasets/bridgeconn/snow_mountain ! [remote rejected] main -> main (pre-receive hook declined) error: failed to push some refs to 'https://huggingface.co/datasets/bridgeconn/snow_mountain' ``` ---
**Author:** ![radames](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/radames/32/28246_2.png) [@radames](https://discuss.huggingface.co/u/radames)\ **Post date:** [February 7, 2023, 7:22am UTC](https://discuss.huggingface.co/t/git-push-rejected/31227/6 "2023-02-07T07:22:32Z")
can you try to track the `*.csv` via lfs? `git lfs track "*.csv"` you might need to restart the repo and force push ---
**Author:** ![anjalyjayakrishnan](https://avatars.discourse-cdn.com/v4/letter/a/b782af/32.png) [@anjalyjayakrishnan](https://discuss.huggingface.co/u/anjalyjayakrishnan)\ **Post date:** [February 9, 2023, 5:40am UTC](https://discuss.huggingface.co/t/git-push-rejected/31227/7 "2023-02-09T05:40:49Z")
@radames , Sorry for the late reply. Tracked csv filesā€¦ still facing the same issue. Do you have any ideas that I can try? ---
**Author:** ![radames](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/radames/32/28246_2.png) [@radames](https://discuss.huggingface.co/u/radames)\ **Post date:** [February 9, 2023, 5:47am UTC](https://discuss.huggingface.co/t/git-push-rejected/31227/8 "2023-02-09T05:47:12Z")
hi @anjalyjayakrishnan sorry itā€™s still not working, is this the repo youā€™re trying? I donā€™t see `csv` tracked on `.gitattributes` here > **[.gitattributes Ā· bridgeconn/snow-mountain at main](https://huggingface.co/datasets/bridgeconn/snow-mountain/blob/main/.gitattributes)** > > Weā€™re on a journey to advance and democratize artificial intelligence through open source and open science. Maybe @mariosasko can help us? ---
**Author:** ![anjalyjayakrishnan](https://avatars.discourse-cdn.com/v4/letter/a/b782af/32.png) [@anjalyjayakrishnan](https://discuss.huggingface.co/u/anjalyjayakrishnan)\ **Post date:** [February 9, 2023, 5:56am UTC](https://discuss.huggingface.co/t/git-push-rejected/31227/9 "2023-02-09T05:56:06Z")
Yes it is the repo. I tried tracking csvs and few more things. But I couldnā€™t push my files. Then started again from my initial commit (thatā€™s why csv not in the `.gitattributes`) and tried to push few audios, csv, and loading script. It worked and you can see that in the repo. Not able to push full data. ---
**Author:** ![radames](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/radames/32/28246_2.png) [@radames](https://discuss.huggingface.co/u/radames)\ **Post date:** [February 9, 2023, 6:12am UTC](https://discuss.huggingface.co/t/git-push-rejected/31227/10 "2023-02-09T06:12:45Z")
ok, Iā€™ve cloned you repo and restart the commits, can you try cloning or [duplicating](https://huggingface.co/spaces/osanseviero/repo_duplicator) [radames/snow-mountain-test Ā· Datasets at Hugging Face](https://huggingface.co/datasets/radames/snow-mountain-test/) and then add, commit and push? Or share a subset of your dataset? ---
**Author:** ![anjalyjayakrishnan](https://avatars.discourse-cdn.com/v4/letter/a/b782af/32.png) [@anjalyjayakrishnan](https://discuss.huggingface.co/u/anjalyjayakrishnan)\ **Post date:** [February 9, 2023, 1:42pm UTC](https://discuss.huggingface.co/t/git-push-rejected/31227/11 "2023-02-09T13:42:12Z")
@radames , Couldnā€™t push data to [radames/snow-mountain-test](https://huggingface.co/datasets/radames/snow-mountain-test/). I can share a part of my dataset. How can I share it? ---
**Author:** ![anjalyjayakrishnan](https://avatars.discourse-cdn.com/v4/letter/a/b782af/32.png) [@anjalyjayakrishnan](https://discuss.huggingface.co/u/anjalyjayakrishnan)\ **Post date:** [February 10, 2023, 12:10am UTC](https://discuss.huggingface.co/t/git-push-rejected/31227/12 "2023-02-10T00:10:42Z")
@radames , Thanks a lot for your time! I managed to push the data. I have sub-directories in my audio folder. Just tried to push by making them zip files. It worked. ---
**Author:** ![stma](https://avatars.discourse-cdn.com/v4/letter/s/f07891/32.png) [@stma](https://discuss.huggingface.co/u/stma)\ **Post date:** [February 16, 2023, 1:20pm UTC](https://discuss.huggingface.co/t/git-push-rejected/31227/13 "2023-02-16T13:20:09Z")
This is happening to me too, donā€™t know how to fix it ```auto Uploading LFS objects: 100% (10000/10000), 8.5 GB | 21 MB/s, done. Enumerating objects: 10014, done. Counting objects: 100% (10014/10014), done. Delta compression using up to 16 threads Compressing objects: 100% (10013/10013), done. Writing objects: 100% (10014/10014), 1.37 MiB | 789.00 KiB/s, done. Total 10014 (delta 0), reused 10014 (delta 0), pack-reused 0 remote: Scanning LFS files for validity... remote: KeyError: 'data' To https://huggingface.co/datasets/stma/danbooru-metadata ! [remote rejected] master -> master (pre-receive hook declined) error: failed to push some refs to 'https://huggingface.co/datasets/stma/danbooru-metadata' ``` ---
**Author:** ![stma](https://avatars.discourse-cdn.com/v4/letter/s/f07891/32.png) [@stma](https://discuss.huggingface.co/u/stma)\ **Post date:** [February 17, 2023, 6:03am UTC](https://discuss.huggingface.co/t/git-push-rejected/31227/14 "2023-02-17T06:03:04Z")
Gave up and tried disabling LFS, now I get this error when trying to push: ```auto Enumerating objects: 24029, done. Counting objects: 100% (24029/24029), done. Delta compression using up to 16 threads Compressing objects: 100% (24027/24027), done. error: RPC failed; HTTP 408 curl 22 The requested URL returned error: 408 send-pack: unexpected disconnect while reading sideband packet Writing objects: 100% (24028/24028), 7.00 GiB | 20.13 MiB/s, done. Total 24028 (delta 0), reused 24028 (delta 0), pack-reused 0 fatal: the remote end hung up unexpectedly Everything up-to-date ``` ---
**Author:** ![stma](https://avatars.discourse-cdn.com/v4/letter/s/f07891/32.png) [@stma](https://discuss.huggingface.co/u/stma)\ **Post date:** [February 17, 2023, 6:19am UTC](https://discuss.huggingface.co/t/git-push-rejected/31227/15 "2023-02-17T06:19:58Z")
Tried again, this time making a single commit for each directory of files. Theyā€™re 12 directories of 1000 zip files each. That worked. Not sure why it would not work if I committed them all at once. Itā€™s 11999 files total ---
**Author:** ![Sylvestre](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/sylvestre/32/24532_2.png) [@Sylvestre](https://discuss.huggingface.co/u/Sylvestre)\ **Post date:** [February 17, 2023, 9:51am UTC](https://discuss.huggingface.co/t/git-push-rejected/31227/16 "2023-02-17T09:51:54Z")
Hello, We have investigated the problem, and we have deployed a fix for it, let me know if happens again Cheers ---
**Author:** ![anjalyjayakrishnan](https://avatars.discourse-cdn.com/v4/letter/a/b782af/32.png) [@anjalyjayakrishnan](https://discuss.huggingface.co/u/anjalyjayakrishnan)\ **Post date:** [March 7, 2023, 7:11am UTC](https://discuss.huggingface.co/t/git-push-rejected/31227/17 "2023-03-07T07:11:27Z")
@stma , I just saw your previous messages. Sorry for this late reply. Hope your issue is fixed. ---
**Author:** ![dkqkxx](https://avatars.discourse-cdn.com/v4/letter/d/d26b3c/32.png) [@dkqkxx](https://discuss.huggingface.co/u/dkqkxx)\ **Post date:** [April 6, 2023, 6:09pm UTC](https://discuss.huggingface.co/t/git-push-rejected/31227/18 "2023-04-06T18:09:34Z")
same errors ![image](https://us1.discourse-cdn.com/hellohellohello/original/2X/0/08769198e2a01047e9719b16abd1011f42818b0b.png) 02:08:06.487430 trace git-lfs: xfer[huggingface-cli]: File ā€œC:\CodeEnv\Python\lib\site-packages\requests\adapters.pyā€, line 559, in send 02:08:06.487939 trace git-lfs: xfer[huggingface-cli]: raise ProxyError(e, request=request) 02:08:06.487960 trace git-lfs: xfer[huggingface-cli]: requests.exceptions.ProxyError: HTTPSConnectionPool(host=ā€˜[s3.us-east-1.amazonaws.com](http://s3.us-east-1.amazonaws.com)ā€™, port=443): Max retries exceeded with url: /lfs.huggingface.co/repos/9e/58/9e5880f0fd2c6de0bed7dce546ecd12063e3c075b291a60eca162833eb16b2d1/cd53101409717bd31a8c726d2e29208ceeb61525ee69254fb952a494308a9867?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Content-Sha256=UNSIGNED-PAYLOAD&X-Amz-Credential=AKIA4N7VTDGO27GPWFUO%2F20230406%2Fus-east-1%2Fs3%2Faws4\_request&X-Amz-Date=20230406T180720Z&X-Amz-Expires=86400&X-Amz-Signature=b7101ccc55fb4e98c8ef51bc3f0da8b5891fc1350a0cd9d3beedf2d41d38cc9e&X-Amz-SignedHeaders=host&partNumber=2&uploadId=4gkaMP4WcOBNSRwowXog\_.HQajNmo.QZdINHdbr2vhvff8dOXAj9GKYHW1Qz0axs8if761DAfrfMM8sn1CeDej99ROsogfiXkxi4eA\_uzhXI9ye8xkKY48eAegYS8Az8&x-id=UploadPart (Caused by ProxyError(ā€˜Cannot connect to proxy.ā€™, ConnectionResetError(10054, ā€˜čæœē؋äø»ęœŗå¼ŗčæ«å…³é—­äŗ†äø€äøŖēŽ°ęœ‰ēš„čæžęŽ„怂ā€™, None, 10054, None))) 02:08:06.511866 trace git-lfs: xfer: adapter ā€œmultipartā€ worker 0 finished job for ā€œcd53101409717bd31a8c726d2e29208ceeb61525ee69254fb952a494308a9867ā€ 02:08:06.511866 trace git-lfs: xfer: adapter ā€œmultipartā€ End() 02:08:06.511866 trace git-lfs: xfer: adapter ā€œmultipartā€ worker 3 stopping 02:08:06.511866 trace git-lfs: xfer: Shutting down adapter worker 3 02:08:06.511866 trace git-lfs: xfer: adapter ā€œmultipartā€ worker 6 stopping 02:08:06.511866 trace git-lfs: xfer: Shutting down adapter worker 6 02:08:06.511866 trace git-lfs: xfer: adapter ā€œmultipartā€ worker 1 stopping 02:08:06.511866 trace git-lfs: xfer: adapter ā€œmultipartā€ worker 0 stopping 02:08:06.511866 trace git-lfs: xfer: Shutting down adapter worker 0 02:08:06.511866 trace git-lfs: xfer: adapter ā€œmultipartā€ worker 2 stopping 02:08:06.511866 trace git-lfs: xfer: Shutting down adapter worker 2 02:08:06.511866 trace git-lfs: xfer: adapter ā€œmultipartā€ worker 4 stopping 02:08:06.511866 trace git-lfs: xfer: Shutting down adapter worker 4 02:08:06.511866 trace git-lfs: xfer: Shutting down adapter worker 1 02:08:06.511866 trace git-lfs: xfer: adapter ā€œmultipartā€ worker 7 stopping 02:08:06.511866 trace git-lfs: xfer: Shutting down adapter worker 7 02:08:06.511866 trace git-lfs: xfer: Custom adapter worker 3 sending message: {ā€œeventā€:ā€œterminateā€} 02:08:06.511866 trace git-lfs: xfer: adapter ā€œmultipartā€ worker 5 stopping 02:08:06.511866 trace git-lfs: xfer: Shutting down adapter worker 5 02:08:06.511866 trace git-lfs: xfer: Custom adapter worker 0 sending message: {ā€œeventā€:ā€œterminateā€} 02:08:06.511866 trace git-lfs: xfer: Custom adapter worker 5 sending message: {ā€œeventā€:ā€œterminateā€} 02:08:06.511866 trace git-lfs: xfer: Custom adapter worker 7 sending message: {ā€œeventā€:ā€œterminateā€} 02:08:06.511866 trace git-lfs: xfer: Custom adapter worker 6 sending message: {ā€œeventā€:ā€œterminateā€} 02:08:06.511866 trace git-lfs: xfer: Custom adapter worker 4 sending message: {ā€œeventā€:ā€œterminateā€} 02:08:06.511866 trace git-lfs: xfer: Custom adapter worker 2 sending message: {ā€œeventā€:ā€œterminateā€} 02:08:06.511866 trace git-lfs: xfer: error finishing up custom transfer process ā€œhuggingface-cliā€ worker 0, aborting: write |1: The pipe is being closed. 02:08:06.511866 trace git-lfs: xfer: Aborting worker process: 0 02:08:06.511866 trace git-lfs: xfer: Custom adapter worker 1 sending message: {ā€œeventā€:ā€œterminateā€} 02:08:06.642464 trace git-lfs: xfer: adapter ā€œmultipartā€ stopped EOFoading LFS objects: 0% (0/1), 16 MB | 204 KB/s error: failed to push some refs to ā€˜[QingyiSi/Alpaca-CoT Ā· Datasets at Hugging Face](https://huggingface.co/datasets/QingyiSi/Alpaca-CoT)ā€™ ---
**Author:** ![luizapzbn](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/luizapzbn/32/15393_2.png) [@luizapzbn](https://discuss.huggingface.co/u/luizapzbn)\ **Post date:** [April 14, 2023, 7:48pm UTC](https://discuss.huggingface.co/t/git-push-rejected/31227/19 "2023-04-14T19:48:06Z")
I was having a similar error. Even though I ran the `git lfs track *.jsonl` it was not working. I suspect it was because my files were in a folder inside the repo. ```auto batch response: Too many password attempts B/s Uploading LFS objects: 0% (0/2), 0 B | 0 B/s, done error: failed to push some refs to 'git@hf.co:datasets......' ``` In my case, I solved it by using `git lfs track FOLDER_NAME`. ---
**Author:** ![radames](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/radames/32/28246_2.png) [@radames](https://discuss.huggingface.co/u/radames)\ **Post date:** [April 14, 2023, 8:56pm UTC](https://discuss.huggingface.co/t/git-push-rejected/31227/20 "2023-04-14T20:56:28Z")
> [@luizapzbn](#): > > git lfs track \*.jsonl Yes you can also do `git lfs track "*.jsonl"` with quotes, so it tracks all the files on the repo and subfolders. You can check your `.gitattributes` to see the differences [Next page](https://discuss.huggingface.co/t/git-push-rejected/31227.md?page=2)