如何从 GitHub 存储库中删除大(>100MB)文件并成功推送?
How to remove big (>100MB) file from a GitHub repository and push successfully?
在无意中添加了一个我不想要的大文件并且在无意中添加了大文件之后完成了其他工作的额外提交(不知道推送会失败)后,我遇到了与此处描述的情况相同的情况:
尝试 #1
试过这个来删除文件:
git rm bigfile
git commit bigfile
git push
运气不好。推送仍然停留在尝试上传大文件,即使后来的提交删除了它:
$git推
Username for 'https://github.com':
Password for 'https://traildreaming@github.com':
Counting objects: 210, done.
Delta compression using up to 4 threads.
Compressing objects: 100% (66/66), done.
Writing objects: 100% (210/210), 5.72 MiB | 1.47 MiB/s, done.
Total 210 (delta 147), reused 203 (delta 140)
remote: error: GH001: Large files detected. You may want to try Git Large File Storage - https://git-lfs.github.com.
remote: error: Trace: eedddea1fcb95663492e16c14fc3a250
remote: error: See http://git.io/iEPt8g for more information.
remote: error: File doc/image.eps is 591.70 MB; this exceeds GitHub's file size limit of 100.00 MB
To https://github.com/traildreaming/myrepo.git
! [remote rejected] master -> master (pre-receive hook declined)
error: failed to push some refs to 'https://github.com/traildreaming/myrepo.git'
尝试 #2
尝试了 https://rtyley.github.io/bfg-repo-cleaner/
的说明
但它没有看到我的大文件,这使我无法进行推送:
$git clone --mirror https://github.com/traildreaming/myrepo.git
Cloning into bare repository 'myrepo.git'...
Username for 'https://github.com':
Password for 'https://traildreaming@github.com':
remote: Counting objects: 20471, done.
remote: Total 20471 (delta 0), reused 0 (delta 0), pack-reused 20471
Receiving objects: 100% (20471/20471), 812.92 MiB | 4.00 MiB/s, done.
Resolving deltas: 100% (14464/14464), done.
Checking connectivity... done.
$ cp -fr myrepo.git myrepo.git.bac
note2@Travel-2015-11 /cygdrive/c/Users/note2/Data/git/tmpmirror
$ java -jar ../bfg-1.12.12.jar --strip-blobs-bigger-than 100M myrepo.git
Using repo : C:\Users\note2\Data\git\tmpmirror\myrepo.git
Scanning packfile for large blobs: 20471
Scanning packfile for large blobs completed in 103 ms.
Warning : no large blobs matching criteria found in packfiles - does the repo need to be packed?
Please specify tasks for The BFG :
bfg 1.12.12
尝试#3
尝试这样做会导致 "remote: error:" 消息:
$ git clone --mirror ../../myrepo/.git
Cloning into bare repository 'myrepo.git'...
done.
$ java -jar bfg-1.12.12.jar --strip-blobs-bigger-than 100M tmpmirror/myrepo/myrepo.git
Using repo : C:\Users\note2\Data\git\tmpmirror\myrepo\myrepo.git
Scanning packfile for large blobs: 12545
Scanning packfile for large blobs completed in 66 ms.
Found 1 blob ids for large blobs - biggest=620441479 smallest=620441479
Total size (unpacked)=620441479
Found 1322 objects to protect
Found 4 commit-pointing refs : HEAD, refs/heads/master, refs/remotes/origin/HEAD, refs/remotes/origin/master
Protected commits
-----------------
These are your protected commits, and so their contents will NOT be altered:
* commit b68c0cbc (protected by 'HEAD')
Cleaning
--------
Found 2769 commits
Cleaning commits: 100% (2769/2769)
Cleaning commits completed in 1,485 ms.
Updating 1 Ref
--------------
Ref Before After
---------------------------------------
refs/heads/master | b68c0cbc | 49823acc
Updating references: 100% (1/1)
...Ref update completed in 18 ms.
Commit Tree-Dirt History
------------------------
Earliest Latest
| |
...........................................................D
D = dirty commits (file tree fixed)
m = modified commits (commit message or parents changed)
. = clean commits (no changes to file tree)
Before After
-------------------------------------------
First modified commit | 0ef7f866 | e3d74aee
Last dirty commit | 338d2b46 | 01ca7b80
Deleted files
-------------
Filename Git id
------------------------------------------------
image.eps | e12fe50b (591.7 MB)
In total, 50 object ids were changed. Full details are logged here:
C:\Users\note2\Data\git\tmpmirror\myrepo\myrepo.git.bfg-report16-06-11-59-30
BFG run is complete! When ready, run: git reflog expire --expire=now --all && git gc --prune=now --aggressive
$ git reflog expire --expire=now --all && git gc --prune=now --aggressive
Counting objects: 20681, done.
Delta compression using up to 4 threads.
Compressing objects: 100% (20114/20114), done.
Writing objects: 100% (20681/20681), done.
Total 20681 (delta 14625), reused 3226 (delta 0)
Removing duplicate objects: 100% (256/256), done.
$git推
Counting objects: 210, done.
Delta compression using up to 4 threads.
Compressing objects: 100% (82/82), done.
Writing objects: 100% (210/210), 1.81 MiB | 0 bytes/s, done.
Total 210 (delta 147), reused 185 (delta 124)
remote: error: refusing to update checked out branch: refs/heads/master
remote: error: By default, updating the current branch in a non-bare repository
remote: error: is denied, because it will make the index and work tree inconsistent
remote: error: with what you pushed, and will require 'git reset --hard' to match
remote: error: the work tree to HEAD.
remote: error:
remote: error: You can set 'receive.denyCurrentBranch' configuration variable to
remote: error: 'ignore' or 'warn' in the remote repository to allow pushing into
remote: error: its current branch; however, this is not recommended unless you
remote: error: arranged to update its work tree to match what you pushed in some
remote: error: other way.
remote: error:
remote: error: To squelch this message and still keep the default behaviour, set
remote: error: 'receive.denyCurrentBranch' configuration variable to 'refuse'.
To /cygdrive/c/Users/note2/Data/git/tmpmirror/myrepo/../../myrepo/.git
! [remote rejected] master -> master (branch is currently checked out)
error: failed to push some refs to '/cygdrive/c/Users/note2/Data/git/tmpmirror/myrepo/../../myrepo/.git'
即使您在最近的提交中删除了该文件,您的历史记录中仍然有它的副本。我认为您会想要将其从 git 中完全删除。
您可能希望将其变基。要了解您何时引入它,您可以这样做:
git log --reverse -n1 doc/image.eps
然后复制它给你的 SHA 并进行交互式变基:
git rebase -i sha~1
保留上述命令中的 ~1
,但将 sha
替换为先前命令输出中的实际 SHA。如果上述命令不起作用,您可能需要设置一个 EDITOR
,例如:
EDITOR=vim git rebase -i sha~1
将 vim
替换为您熟悉的任何命令行编辑器(emacs
、nano
等)。您可以让它与 atom
这样的 GUI 编辑器一起工作,但您可能需要传递额外的参数来强制进程等待,直到您关闭 window。如果你使用 atom
你可以 运行:
EDITOR="atom --wait" git rebase -i sha~1
这将带您回到过去。第一行将有 pick
。您需要将其更改为 edit
。然后保存并退出编辑器。不要更改任何其他 pick
s.
这将使您回到引入大文件的提交。您现在可以将其从 git:
中删除
git rm doc/image.eps && git commit --amend
然后继续变基:
git rebase --continue
如果一切顺利完成,那么您就完成了。你应该可以 git push
。但是,如果没有,那么您可能在以后的提交中更新了图像。每次它停止时,您都需要执行我们在上面所做的相同 git rm doc/image.eps && git commit --amend && git rebase --continue
。
我假设了很多事情,所以我希望您对 git、编辑器和命令行足够熟悉,以便使用这些信息。
P.S。可能有更短和更简洁的方法来做到这一点,但既然你问这个问题,我假设你不想要一个神奇的 git
命令,它会自行撕毁你的历史。那么首先,让我们一步步尝试吧。
以下是我在 "git push" 由于添加和提交一个大文件然后在离开互联网时继续提交其他工作而卡住之后如何让它工作:
我从以下位置下载了 bfg*jar:
https://rtyley.github.io/bfg-repo-cleaner/
cd tmpmirror; mkdir myrepo; cd myrepo; git clone --mirror ../../myrepo/.git
java -jar bfg-1.12.12.jar --strip-blobs-bigger-than 100M myrepo.git
cd myrepo.git; git reflog expire --expire=now --all && git gc --prune=now --aggressive
git push https://github.com/traildreaming/myrepo
cd ../../..
mv myrepo myrepo_old
git clone https://github.com/traildreaming/myrepo
cd myrepo
如果您收到此消息,请尝试执行下面的额外步骤
$ java -jar ../../bfg-1.12.13.jar --strip-blobs-bigger-than 100M myrepo.git
Using repo : [DIR]\tmpmirror\myrepo\myrepo.git
Scanning packfile for large blobs: 20681
Scanning packfile for large blobs completed in 135 ms.
Warning : no large blobs matching criteria found in packfiles - does the repo need to be packed?
Please specify tasks for The BFG :
bfg 1.12.13
Usage: bfg [options] [<repo>]
-b <size> | --strip-blobs-bigger-than <size>
strip blobs bigger than X (eg '128K', '1M', etc)
```
cd tmpmirror; mkdir myrepo; cd myrepo; git clone --mirror ../../myrepo/.git
cd myrepo.git; git repack; cd ..
java -jar bfg-1.12.12.jar --strip-blobs-bigger-than 100M myrepo.git
cd myrepo.git; git reflog expire --expire=now --all && git gc --prune=now --aggressive
git push https://github.com/traildreaming/myrepo
cd ../../..
mv myrepo myrepo_old
git clone https://github.com/traildreaming/myrepo
cd myrepo
然后继续在新克隆的存储库中工作。感谢 to use "git push https://github.com/traildreaming/myrepo" 而不是 "git push".
的建议
在无意中添加了一个我不想要的大文件并且在无意中添加了大文件之后完成了其他工作的额外提交(不知道推送会失败)后,我遇到了与此处描述的情况相同的情况:
尝试 #1 试过这个来删除文件:
git rm bigfile
git commit bigfile
git push
运气不好。推送仍然停留在尝试上传大文件,即使后来的提交删除了它:
$git推
Username for 'https://github.com':
Password for 'https://traildreaming@github.com':
Counting objects: 210, done.
Delta compression using up to 4 threads.
Compressing objects: 100% (66/66), done.
Writing objects: 100% (210/210), 5.72 MiB | 1.47 MiB/s, done.
Total 210 (delta 147), reused 203 (delta 140)
remote: error: GH001: Large files detected. You may want to try Git Large File Storage - https://git-lfs.github.com.
remote: error: Trace: eedddea1fcb95663492e16c14fc3a250
remote: error: See http://git.io/iEPt8g for more information.
remote: error: File doc/image.eps is 591.70 MB; this exceeds GitHub's file size limit of 100.00 MB
To https://github.com/traildreaming/myrepo.git
! [remote rejected] master -> master (pre-receive hook declined)
error: failed to push some refs to 'https://github.com/traildreaming/myrepo.git'
尝试 #2 尝试了 https://rtyley.github.io/bfg-repo-cleaner/
的说明但它没有看到我的大文件,这使我无法进行推送:
$git clone --mirror https://github.com/traildreaming/myrepo.git
Cloning into bare repository 'myrepo.git'...
Username for 'https://github.com':
Password for 'https://traildreaming@github.com':
remote: Counting objects: 20471, done.
remote: Total 20471 (delta 0), reused 0 (delta 0), pack-reused 20471
Receiving objects: 100% (20471/20471), 812.92 MiB | 4.00 MiB/s, done.
Resolving deltas: 100% (14464/14464), done.
Checking connectivity... done.
$ cp -fr myrepo.git myrepo.git.bac
note2@Travel-2015-11 /cygdrive/c/Users/note2/Data/git/tmpmirror
$ java -jar ../bfg-1.12.12.jar --strip-blobs-bigger-than 100M myrepo.git
Using repo : C:\Users\note2\Data\git\tmpmirror\myrepo.git
Scanning packfile for large blobs: 20471
Scanning packfile for large blobs completed in 103 ms.
Warning : no large blobs matching criteria found in packfiles - does the repo need to be packed?
Please specify tasks for The BFG :
bfg 1.12.12
尝试#3 尝试这样做会导致 "remote: error:" 消息:
$ git clone --mirror ../../myrepo/.git
Cloning into bare repository 'myrepo.git'...
done.
$ java -jar bfg-1.12.12.jar --strip-blobs-bigger-than 100M tmpmirror/myrepo/myrepo.git
Using repo : C:\Users\note2\Data\git\tmpmirror\myrepo\myrepo.git
Scanning packfile for large blobs: 12545
Scanning packfile for large blobs completed in 66 ms.
Found 1 blob ids for large blobs - biggest=620441479 smallest=620441479
Total size (unpacked)=620441479
Found 1322 objects to protect
Found 4 commit-pointing refs : HEAD, refs/heads/master, refs/remotes/origin/HEAD, refs/remotes/origin/master
Protected commits
-----------------
These are your protected commits, and so their contents will NOT be altered:
* commit b68c0cbc (protected by 'HEAD')
Cleaning
--------
Found 2769 commits
Cleaning commits: 100% (2769/2769)
Cleaning commits completed in 1,485 ms.
Updating 1 Ref
--------------
Ref Before After
---------------------------------------
refs/heads/master | b68c0cbc | 49823acc
Updating references: 100% (1/1)
...Ref update completed in 18 ms.
Commit Tree-Dirt History
------------------------
Earliest Latest
| |
...........................................................D
D = dirty commits (file tree fixed)
m = modified commits (commit message or parents changed)
. = clean commits (no changes to file tree)
Before After
-------------------------------------------
First modified commit | 0ef7f866 | e3d74aee
Last dirty commit | 338d2b46 | 01ca7b80
Deleted files
-------------
Filename Git id
------------------------------------------------
image.eps | e12fe50b (591.7 MB)
In total, 50 object ids were changed. Full details are logged here:
C:\Users\note2\Data\git\tmpmirror\myrepo\myrepo.git.bfg-report16-06-11-59-30
BFG run is complete! When ready, run: git reflog expire --expire=now --all && git gc --prune=now --aggressive
$ git reflog expire --expire=now --all && git gc --prune=now --aggressive
Counting objects: 20681, done.
Delta compression using up to 4 threads.
Compressing objects: 100% (20114/20114), done.
Writing objects: 100% (20681/20681), done.
Total 20681 (delta 14625), reused 3226 (delta 0)
Removing duplicate objects: 100% (256/256), done.
$git推
Counting objects: 210, done.
Delta compression using up to 4 threads.
Compressing objects: 100% (82/82), done.
Writing objects: 100% (210/210), 1.81 MiB | 0 bytes/s, done.
Total 210 (delta 147), reused 185 (delta 124)
remote: error: refusing to update checked out branch: refs/heads/master
remote: error: By default, updating the current branch in a non-bare repository
remote: error: is denied, because it will make the index and work tree inconsistent
remote: error: with what you pushed, and will require 'git reset --hard' to match
remote: error: the work tree to HEAD.
remote: error:
remote: error: You can set 'receive.denyCurrentBranch' configuration variable to
remote: error: 'ignore' or 'warn' in the remote repository to allow pushing into
remote: error: its current branch; however, this is not recommended unless you
remote: error: arranged to update its work tree to match what you pushed in some
remote: error: other way.
remote: error:
remote: error: To squelch this message and still keep the default behaviour, set
remote: error: 'receive.denyCurrentBranch' configuration variable to 'refuse'.
To /cygdrive/c/Users/note2/Data/git/tmpmirror/myrepo/../../myrepo/.git
! [remote rejected] master -> master (branch is currently checked out)
error: failed to push some refs to '/cygdrive/c/Users/note2/Data/git/tmpmirror/myrepo/../../myrepo/.git'
即使您在最近的提交中删除了该文件,您的历史记录中仍然有它的副本。我认为您会想要将其从 git 中完全删除。
您可能希望将其变基。要了解您何时引入它,您可以这样做:
git log --reverse -n1 doc/image.eps
然后复制它给你的 SHA 并进行交互式变基:
git rebase -i sha~1
保留上述命令中的 ~1
,但将 sha
替换为先前命令输出中的实际 SHA。如果上述命令不起作用,您可能需要设置一个 EDITOR
,例如:
EDITOR=vim git rebase -i sha~1
将 vim
替换为您熟悉的任何命令行编辑器(emacs
、nano
等)。您可以让它与 atom
这样的 GUI 编辑器一起工作,但您可能需要传递额外的参数来强制进程等待,直到您关闭 window。如果你使用 atom
你可以 运行:
EDITOR="atom --wait" git rebase -i sha~1
这将带您回到过去。第一行将有 pick
。您需要将其更改为 edit
。然后保存并退出编辑器。不要更改任何其他 pick
s.
这将使您回到引入大文件的提交。您现在可以将其从 git:
中删除git rm doc/image.eps && git commit --amend
然后继续变基:
git rebase --continue
如果一切顺利完成,那么您就完成了。你应该可以 git push
。但是,如果没有,那么您可能在以后的提交中更新了图像。每次它停止时,您都需要执行我们在上面所做的相同 git rm doc/image.eps && git commit --amend && git rebase --continue
。
我假设了很多事情,所以我希望您对 git、编辑器和命令行足够熟悉,以便使用这些信息。
P.S。可能有更短和更简洁的方法来做到这一点,但既然你问这个问题,我假设你不想要一个神奇的 git
命令,它会自行撕毁你的历史。那么首先,让我们一步步尝试吧。
以下是我在 "git push" 由于添加和提交一个大文件然后在离开互联网时继续提交其他工作而卡住之后如何让它工作:
我从以下位置下载了 bfg*jar:
https://rtyley.github.io/bfg-repo-cleaner/
cd tmpmirror; mkdir myrepo; cd myrepo; git clone --mirror ../../myrepo/.git
java -jar bfg-1.12.12.jar --strip-blobs-bigger-than 100M myrepo.git
cd myrepo.git; git reflog expire --expire=now --all && git gc --prune=now --aggressive
git push https://github.com/traildreaming/myrepo
cd ../../..
mv myrepo myrepo_old
git clone https://github.com/traildreaming/myrepo
cd myrepo
如果您收到此消息,请尝试执行下面的额外步骤
$ java -jar ../../bfg-1.12.13.jar --strip-blobs-bigger-than 100M myrepo.git
Using repo : [DIR]\tmpmirror\myrepo\myrepo.git
Scanning packfile for large blobs: 20681
Scanning packfile for large blobs completed in 135 ms.
Warning : no large blobs matching criteria found in packfiles - does the repo need to be packed?
Please specify tasks for The BFG :
bfg 1.12.13
Usage: bfg [options] [<repo>]
-b <size> | --strip-blobs-bigger-than <size>
strip blobs bigger than X (eg '128K', '1M', etc)
```
cd tmpmirror; mkdir myrepo; cd myrepo; git clone --mirror ../../myrepo/.git
cd myrepo.git; git repack; cd ..
java -jar bfg-1.12.12.jar --strip-blobs-bigger-than 100M myrepo.git
cd myrepo.git; git reflog expire --expire=now --all && git gc --prune=now --aggressive
git push https://github.com/traildreaming/myrepo
cd ../../..
mv myrepo myrepo_old
git clone https://github.com/traildreaming/myrepo
cd myrepo
然后继续在新克隆的存储库中工作。感谢