BlockingIOError in verbose mode

[Ernest0x]

With latest attic (commit: 50cabd5) as well as with previous commits and verbose mode:

Traceback (most recent call last):
  File "/usr/local/bin/attic", line 5, in <module>
    pkg_resources.run_script('Attic==0.9-6-g50cabd5', 'attic')
  File "/usr/local/lib/python3.3/site-packages/setuptools-2.0-py3.3.egg/pkg_resources.py", line 483, in run_script
  File "/usr/local/lib/python3.3/site-packages/setuptools-2.0-py3.3.egg/pkg_resources.py", line 1341, in run_script
  File "/usr/local/lib/python3.3/site-packages/setuptools-2.0-py3.3.egg/pkg_resources.py", line 50, in execfile
  File "/usr/local/lib/python3.3/site-packages/Attic-0.9_6_g50cabd5-py3.3-linux-x86_64.egg/EGG-INFO/scripts/attic", line 3, in <module>
    main()
  File "/usr/local/lib/python3.3/site-packages/Attic-0.9_6_g50cabd5-py3.3-linux-x86_64.egg/attic/archiver.py", line 479, in main
    exit_code = archiver.run(sys.argv[1:])
  File "/usr/local/lib/python3.3/site-packages/Attic-0.9_6_g50cabd5-py3.3-linux-x86_64.egg/attic/archiver.py", line 473, in run
    return args.func(args)
  File "/usr/local/lib/python3.3/site-packages/Attic-0.9_6_g50cabd5-py3.3-linux-x86_64.egg/attic/archiver.py", line 104, in do_create
    self._process(archive, cache, args.excludes, skip_inodes, path, restrict_dev)
  File "/usr/local/lib/python3.3/site-packages/Attic-0.9_6_g50cabd5-py3.3-linux-x86_64.egg/attic/archiver.py", line 150, in _process
    os.path.join(path, filename), restrict_dev)
  File "/usr/local/lib/python3.3/site-packages/Attic-0.9_6_g50cabd5-py3.3-linux-x86_64.egg/attic/archiver.py", line 150, in _process
    os.path.join(path, filename), restrict_dev)
  File "/usr/local/lib/python3.3/site-packages/Attic-0.9_6_g50cabd5-py3.3-linux-x86_64.egg/attic/archiver.py", line 150, in _process
    os.path.join(path, filename), restrict_dev)
  File "/usr/local/lib/python3.3/site-packages/Attic-0.9_6_g50cabd5-py3.3-linux-x86_64.egg/attic/archiver.py", line 150, in _process
    os.path.join(path, filename), restrict_dev)
  File "/usr/local/lib/python3.3/site-packages/Attic-0.9_6_g50cabd5-py3.3-linux-x86_64.egg/attic/archiver.py", line 150, in _process
    os.path.join(path, filename), restrict_dev)
  File "/usr/local/lib/python3.3/site-packages/Attic-0.9_6_g50cabd5-py3.3-linux-x86_64.egg/attic/archiver.py", line 150, in _process
    os.path.join(path, filename), restrict_dev)
  File "/usr/local/lib/python3.3/site-packages/Attic-0.9_6_g50cabd5-py3.3-linux-x86_64.egg/attic/archiver.py", line 150, in _process
    os.path.join(path, filename), restrict_dev)
  File "/usr/local/lib/python3.3/site-packages/Attic-0.9_6_g50cabd5-py3.3-linux-x86_64.egg/attic/archiver.py", line 150, in _process
    os.path.join(path, filename), restrict_dev)
  File "/usr/local/lib/python3.3/site-packages/Attic-0.9_6_g50cabd5-py3.3-linux-x86_64.egg/attic/archiver.py", line 135, in _process
    self.print_verbose(remove_surrogates(path))
  File "/usr/local/lib/python3.3/site-packages/Attic-0.9_6_g50cabd5-py3.3-linux-x86_64.egg/attic/archiver.py", line 42, in print_verbose
    print(msg)
BlockingIOError: [Errno 11] write could not complete without blocking
Exception BlockingIOError: BlockingIOError(11, 'write could not complete without blocking', 0) in <_io.TextIOWrapper name='<stdout>' mode='w' encoding='UTF-8'> ignored

I had trouble trying to backup around ~330GB/1.5 million files of data to a remote repository, so I enabled verbose mode to see what is happening and I reached to a point that the above error occured.

The remote repository path on the remote host is under an NFS mount on another remote host (NFS server), so the setup can be described like this: backup source host --SSH--> remote host --NFS--> repository path. This setup works without problems with other backup source hosts with far less data (up to 7GB e.g.) sending their backups on the same remote host under the same NFS mount, so I suspect that the bigger size of the source data or maybe the longer time needed to send these may play a role on this.

Any idea what may be causing this?

[jborg]

Exactly what kind of problem did you have before you enabled verbose mode?

The reason I ask is because your traceback seems to be from a problem triggered by the verbose mode itself and not your original problem.

The traceback shows that the print statement that prints the filenames in verbose mode raised an BlockingIOError for some reason. This is really strange since stdout is supposed to be in blocking mode by default and Attic never sets sys.stdout to non-blocking.

Did you do something special with stdout while running this command, like piping the output to a file or less or something else?

You could also try to run the following python program to verify that stdout is indeed in blocking mode on your system:

import os, sys, fcntl
print('stdout is {}'.format('non-blocking' if fcntl.fcntl(sys.stdout, fcntl.F_GETFL) & os.O_NONBLOCK else 'blocking'))

it should say "stdout is blocking"

[Ernest0x]

Before I enabled verbose mode, I had the problem of the create operation never ending (after several days). I have to say though that this was before the recent deadlock fix and that there are some empty files at the backup source.
The last ~12 hours I have a create operation running without verbose mode with the latest version (including deadlock fix) and wait to see if it will eventually end (hopefully succeessfully).

The BlockingIOError is indeed strange, because running the python program you suggested above always gives "stdout is blocking". I do have a wrapper shell script that calls attic, and I do a "trick" to redirect stdout to both a shell variable and stdout and then I redirect stdout to a log file. But even if I do the same things with the program above, it still outputs "stdout is blocking", so I can't see a problem with that. My wrapper script looks like this:

 exec 5>&1
 STDOUT_COPY=/dev/fd/5
 OUTPUTVAR=$(eval "python3 test.py 2>&1 | tee -a $STDOUT_COPY")

And I call this script like this:

  ./test.sh >> test.log 2>&1

[jborg]

First, the deadlock fix in 0.10 should only affect archive extraction and not creation so this is probably something else.

Even without verbose mode it should be fairly easy to determine if it's stuck or not, just check if the attic process is consuming any cpu time (or generating any network traffic).

If it is stuck again try verbose mode again but this time without any weird shell redirection. It might also be a good idea to comment out the following lines from archiver.py to get a traceback when you later press ctrl+c on the hung process:

    except KeyboardInterrupt:
        archiver.print_error('Error: Keyboard interrupt')
        exit_code = 1

I did a quick test with your "hack" and my test process was killed by the shell after about 2GB of stdout output (But I got BrokenPipeError and not BlockingIOError).

[Ernest0x]

The attic create operation I mention above started (in non-verbose mode) at Feb 01 00:00:02 (local time) and is still running after all these days. It's not stuck because the process gets CPU time from time to time, and the attic serve process at the remote repository server is also creating a lot of I/O.

I suspect that there is some kind of never ending loop that takes place, because the size of the backup source data as well as the network speed between the remote repository server and the NFS server clearly do not justify such a prolonged operation. Data size is about ~350GB and the network between remote repository server and NFS server is supported by a wireless link that can sustain a speed of 3MB/sec or even more and which has been stable all these days. If I were to rsync the data, I would expect the operation to have finished in less that 2 days. The network between the backup source host and the remote repository server is not a bottleneck either because they both are virtual machines on the same host.

The repository has already reached a size of ~200GB and that size does not look to change significantly from day to day (e.g. yesterday was 201GB, today is 202.5GB).
Also, I attached strace to the attic serve and found out that an ioctl() call is always failing with an ENOTTY error after (successful) open() calls on repository data files, but maybe this is irrelevant and/or normal:

 stat("/path/to/repository/index.55007", {st_mode=S_IFREG|0640, st_size=335544338, ...}) = 0
chmod("/path/to/repository/index.tmp", 0640) = 0
open("/path/to/repository/index.tmp", O_RDWR) = 4
lseek(4, 0, SEEK_END)                   = 335544338
mmap(NULL, 335544338, PROT_READ|PROT_WRITE, MAP_SHARED, 4, 0) = 0x7f0b65f9d000
close(4)                                = 0
munmap(0x7f0b7a99f000, 335544338)       = 0
open("/path/to/repository/hints.55007", O_RDONLY) = 4
fstat(4, {st_mode=S_IFREG|0640, st_size=171475, ...}) = 0
ioctl(4, SNDCTL_TMR_TIMEBASE or TCGETS, 0x7fffec8b4350) = -1 ENOTTY (Inappropriate ioctl for device)
fstat(4, {st_mode=S_IFREG|0640, st_size=171475, ...}) = 0
lseek(4, 0, SEEK_CUR)                   = 0
fstat(4, {st_mode=S_IFREG|0640, st_size=171475, ...}) = 0
lseek(4, 0, SEEK_CUR)                   = 0
read(4, "\203\247compact\220\250segments\336\240\331\1f\2q\3I\4]\5]"..., 171476) = 171475
fstat(4, {st_mode=S_IFREG|0640, st_size=171475, ...}) = 0
lseek(4, 0, SEEK_CUR)                   = 171475
read(4, "", 1)                          = 0
fstat(4, {st_mode=S_IFREG|0640, st_size=171475, ...}) = 0
lseek(4, 0, SEEK_CUR)                   = 171475
read(4, "", 1)                          = 0
close(4)

Any ideas on how to debug it further? Is it easy for anyone else to test a setup like mine (backup ~350GB of data on a remote repository with an NFS storage backend)?

[jborg]

Something is definitely wrong if the repository only grew 1GB in 24 hours.

The strace output looks like it comes from the creation of a new transaction. Attic automatically commits a checkpoint archive every 5 minutes to minimize the data loss if a large backup is aborted for whatever reason. And after each commit a new transaction is started and that would look like this.
What did the output say after that? It should contain a lot of "open('data/0/X'), write(), write(), ..., close(); open('data/0/X+1"),..." And then after 5 minutes a new commit transaction + start transaction.

Also if you decide to stop this backup "attic list" should list an archive called "your-archive-name.snapshot" which should contain all the files archived until the last checkpoint commit.

Ot's hard to know if this is an NFS issue, remote repository bug or something with the data you're backing up. If you're able to do some or all of the following test it would be much easier to figure out what's going wrong:

1. Test if nfs is the problem. Create a large repository on nfs using a local (non remote) repository. It must not be exactly as large or the same data. But the closer to the problematic backup the better.
2. Test if the remote repository is the problem. Backup the same files (or as much as you have space for) to a remote repository that is placed on a regular file system.
3. Test if it is the data that's causing the problem. Backup the exact same data to some other place (remote and/or local).

Also, run any further test with --verbose and without any weird redirect hacks to make things easier to monitor.

/ Jonas

[Ernest0x]

Dan Christensen asked in the mailing list:

Just out of curiosity, how much RAM are the attic processes using, and
are they swapping?

I reply here, to keep relevant discussion in one place.
The attic create process on the backup source does use a lot of ram (700 MB - 800 MB) and does swap since that host has only 1GB of RAM. Also the swap size is inappropriately small (only 256MB), but will not run full unless you run something else that consumes memory (e.g. a du process) . The attic serve process on the remote repository server does not use much RAM.

I will come back with more info, after I do the tests that Jonas suggested.

[Ernest0x]

I think that the problem is related to how attic is using memory.

I added locally a virtual disk with enough size and tried to backup the same data on a repository created on that local disk. Attic eventually ate all RAM, and was oom-killed along with other processes. The machine is a vm with 1GB RAM and 256MB swap space running an OpenMediaVault installation. I understand that 256MB of swap space for 1GB of RAM is bad configuration, but I am not sure whether more swap space would make a great difference. Besides, before running attic, only 100MB of RAM are consumed.

At first look, the situation this time (with the repository stored on a local disc) was somehow different in that the attic process was eventually killed by the kernel and not stalled in an never-ending state, but I guess that this happened because the machine this time needed more RAM for caching I/O on local disk too.

I also crossed into another problem. Besides eating all RAM, attic also consumed the rootfs by writing to ~/.cache/attic. I am not sure why this path is used by default instead of a path inside the repository root path, but It seems that data there is never cleaned and on each invocation of attic a great amount of data is stored and left forever there.

About RAM consumption:
Does attic require more than 1G RAM to backup 350G of data and how much RAM is enough?
Are there any thoughts on what can be done to improve memory usage on systems with less RAM (e.g. reducing buffer sizes) even if sacrificing on speed?

[jborg]

The deduplication used by Attic divides file data into small chunks that are on average 64kB in size. Keeping track of these chunks requires a fair bit of memory.

If you in your case have 350GB of unique data (after deduplication) that will be split into about 5.3 million chunks (N).

The memory usage breaks down to the following main areas:

• Repository index: 40 bytes x N ~ 200MB (If a remote repository is used this will be allocated on the remote side)
• Chunk lookup index: 44 bytes x N ~ 220MB
• File chunk cache: probably 80-100 bytes x N ~ 400MB

So if we add these numbers together (200+220+400=820MB) we get close to the amount of ram you have available on your system.

Attic should probably have an option to not load/create the "file chunk cache" since it's not strictly required and consumes a lot of ram. But without it Attic will be a lot slower since it then would have to re-read "unmodified" files.

~/.cache/attic// is a directory containing the "chunk lookup index" and the "file chunk cache" files for a specific repository. So you should only see new directories showing up there if you create new repositories. Attic will automatically recreate the cache directory if it's missing or damaged but that operation takes some time for large repositories.

[Ernest0x]

I did some more tests and I found out that attic's high memory usage is not related to the never-ending create process I am reporting here. I increased the memory from 1G to 2G and ran the attic create process in three different scenarios with the following results:

• With local repository on a virtual disk in the same vm: SUCCESS
• With remote repository on a virtual disk on a different VM (but on the same host): SUCCESS
• With remote repository on a different VM (on the same host), but with the repository path inside a path mounted on a remote NFS server: NEVER-ENDING

As far as the RAM usage is concerned, running htop I saw attic create process to reach up to ~1200MB of RES (resident) memory (for backing up ~350GB of data). This is about 65% more than the 820 megabytes estimated above. Is this possible?

[jborg]

On 2014-02-25 14:55 , Petros Moisiadis wrote:

I did some more tests and I found out that attic's high memory usage is
not related to the never-ending create process I am reporting here. I
increased the memory from 1G to 2G and ran the |attic create| process in
three different scenarios with the following results:

• With local repository on a virtual disk in the same vm: SUCCESS
• With remote repository on a virtual disk on a different VM (but on
  the same host): SUCCESS
• With remote repository on a different VM (on the same host), but
  with the repository path inside a path mounted on a remote NFS
  server: NEVER-ENDING

As far as the RAM usage is concerned, running |htop| I saw |attic
create| process to reach up to ~1200MB of RES (resident) memory (for
backing up ~350GB of data). This is about 65% more than the 820
megabytes estimated above. Is this possible?

From which of these three tests does the 1200MB figure come from? I
expect the first test to consume most memory and the other two should
consume less since the repository index is loaded on the remote host.

It sounds a bit high but I guess it's possible. But in that case the
file cache consumes more space than I anticipated (See #45).

Are you able to repeat the test one more time with a local repository
placed on nfs?
This would tell us if the remote repository code has some race condition
or similar or if the nfs fileystem is just being really slow.

And if the process seems to stop/hang. Try using strace or similar to
figure out what it is doing.

/ Jonas

[Ernest0x]

I have not run (yet) a test on a local repository on (locally mounted) NFS storage, but I was able to collect some (hopefully useful) debug data from an attic instance running several days now on my remote repository + NFS storage backend setup.

By enabling verbose mode, I found out that what happens is not a never-ending loop as I had speculated earlier. Instead, I found attic to have ended up in a condition of being extremely slow and entering in blocking mode for a very long period just to handle a single file of ~15k in size. My data source has some directories with a lot of small jpg files (around ~15k each). I can see attic taking e.g ~6 minutes between two successive output lines. 6 minutes to handle a single ~16k jpg file!

So, I got to attach gdb on the attic serve process on the remote repository host to see what is going on, and I found out that it is indeed blocking in two positions. That means that whenever I hit ctrl+c to break execution, 99% of the time it would be on one of two positions in the code. I am posting the details below:

position 1:

Python stack:
  File "/usr/lib/python3.2/shutil.py", line 65, in copyfileobj
    buf = fsrc.read(length)
  (frame information optimized out)
  (frame information optimized out)
  (frame information optimized out)
  File "/usr/local/lib/python3.2/dist-packages/Attic-0.10_53_gea70050-py3.2-linux-x86_64.egg/attic/repository.py", line 329, in delete
    self.get_index(self.get_transaction_id())
  (frame information optimized out)
  (frame information optimized out)
  File "/usr/local/lib/python3.2/dist-packages/Attic-0.10_53_gea70050-py3.2-linux-x86_64.egg/attic/archiver.py", line 414, in run
    return self.do_serve()
  (frame information optimized out)
  File "/usr/local/lib/python3.2/dist-packages/Attic-0.10_53_gea70050-py3.2-linux-x86_64.egg/EGG-INFO/scripts/attic", line 3, in <module>
    main()
  (frame information optimized out)
  (frame information optimized out)
  File "/usr/local/bin/attic", line 5, in <module>
    pkg_resources.run_script('Attic==0.10-53-gea70050', 'attic')

C stack:
  #0  0x00007fe48755b170 in __read_nocancel () from /lib/x86_64-linux-gnu/libpthread.so.0
  #1  0x000000000050c355 in fileio_readinto.48456 (self=0x7fe484238e18, args=<optimized out>)
      at /usr/include/x86_64-linux-gnu/bits/unistd.h:45
  #2  0x00000000004a833b in PyObject_Call (func=func@entry=
      <built-in method readinto of _io.FileIO object at remote 0x7fe484238e18>, arg=arg@entry=
      (<memoryview at remote 0x7fe4851feef0>,), kw=kw@entry=0x0) at ../Objects/abstract.c:2149
  #3  0x0000000000496fae in PyObject_CallMethodObjArgs (callable=
      <built-in method readinto of _io.FileIO object at remote 0x7fe484238e18>, name=<optimized out>)
      at ../Objects/abstract.c:2350
  #4  0x0000000000512248 in _bufferedreader_raw_read (self=self@entry=0x7fe484226d40, start=<optimized out>, len=262144)
      at ../Modules/_io/bufferedio.c:1327
  #5  0x0000000000494942 in _bufferedreader_fill_buffer (self=0x7fe484226d40) at ../Modules/_io/bufferedio.c:1359
  #6  _bufferedreader_read_generic (n=<optimized out>, self=0x7fe484226d40) at ../Modules/_io/bufferedio.c:1521
  #7  buffered_read.49766 (self=0x7fe484226d40, args=<optimized out>) at ../Modules/_io/bufferedio.c:873
  #8  0x00000000004b666f in call_function (oparg=<optimized out>, pp_stack=0x7fffb04bfb90) at ../Python/ceval.c:3921
  #9  PyEval_EvalFrameEx (f=f@entry=
      Frame 0x2adb6b0, for file /usr/lib/python3.2/shutil.py, line 65, in copyfileobj (fsrc=<_io.BufferedReader at remote 0x7fe484226d40>, fdst=<_io.BufferedWriter at remote 0x31cb330>, length=16384, buf=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\xff\xff\xff\xff\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\xff\xff\xff\xff\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\xff\xff\xff\xff\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\xff\xff\xff\xff\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\xff\xff\xff\xff\x00\x00\x00\x00\x04\x98\xc8q1S\xc1\x8e\r}\x16`\x89\xe9/\x1c#\xcb\xb2\xafi\x11\xf8.\xcaq-9k\xdf!j\xc3\xa9\x00\x00R\xafA\x00\x00\...(truncated), throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
  #10 0x00000000004cdee7 in PyEval_EvalCodeEx (_co=<optimized out>, globals=<optimized out>, locals=locals@entry=0x0, 
      args=<optimized out>, argcount=argcount@entry=2, kws=0x2adaf40, kwcount=0, defs=0x7fe4860ecce8, defcount=1, kwdefs=0x0, 
      closure=0x0) at ../Python/ceval.c:3350
  #11 0x00000000004ba764 in fast_function (nk=<optimized out>, na=2, n=<optimized out>, pp_stack=0x7fffb04bfe00, func=
      <function at remote 0x7fe4860f4d10>) at ../Python/ceval.c:4019
  #12 call_function (oparg=<optimized out>, pp_stack=0x7fffb04bfe00) at ../Python/ceval.c:3942
  #13 PyEval_EvalFrameEx (f=<optimized out>, throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
  #14 0x00000000004ba36e in fast_function (nk=<optimized out>, na=2, n=<optimized out>, pp_stack=0x7fffb04bffb0, func=
      <function at remote 0x7fe4860f40d8>) at ../Python/ceval.c:4009
  #15 call_function (oparg=<optimized out>, pp_stack=0x7fffb04bffb0) at ../Python/ceval.c:3942
  #16 PyEval_EvalFrameEx (f=<optimized out>, throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
  #17 0x00000000004ba36e in fast_function (nk=<optimized out>, na=2, n=<optimized out>, pp_stack=0x7fffb04c0160, func=
      <function at remote 0x7fe4860f4160>) at ../Python/ceval.c:4009
  ---Type <return> to continue, or q <return> to quit---
  #18 call_function (oparg=<optimized out>, pp_stack=0x7fffb04c0160) at ../Python/ceval.c:3942
  #19 PyEval_EvalFrameEx (f=<optimized out>, throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
  #20 0x00000000004ba36e in fast_function (nk=<optimized out>, na=2, n=<optimized out>, pp_stack=0x7fffb04c0310, func=
      <function at remote 0x7fe4842197c0>) at ../Python/ceval.c:4009
  #21 call_function (oparg=<optimized out>, pp_stack=0x7fffb04c0310) at ../Python/ceval.c:3942
  #22 PyEval_EvalFrameEx (f=f@entry=
      Frame 0x2ad59e0, for file /usr/local/lib/python3.2/dist-packages/Attic-0.10_53_gea70050-py3.2-linux-x86_64.egg/attic/repository.py, line 329, in delete (self=<Repository(compact=set(), _active_txn=False, index=None, max_segment_size=5242880, lock=<UpgradableLock(path='/path/to/repository/config', fd=<_io.TextIOWrapper at remote 0x7fe485200a70>, is_exclusive=True) at remote 0x7fe484225110>, segments_per_dir=10000, segments={1: 102, 2: 113, 3: 73, 4: 93, 5: 93, 6: 72, 7: 88, 8: 84, 9: 76, 10: 112, 11: 132, 12: 141, 13: 133, 14: 117, 15: 129, 16: 123, 17: 147, 18: 131, 19: 118, 20: 126, 21: 131, 22: 121, 23: 145, 24: 130, 25: 121, 26: 127, 27: 130, 28: 132, 29: 128, 30: 131, 31: 127, 32: 127, 33: 120, 34: 83, 35: 98, 36: 92, 37: 70, 38: 74, 39: 109, 40: 87, 41: 87, 42: 104, 43: 91, 44: 107, 45: 193, 46: 220, 47: 230, 48: 202, 49: 195, 50: 206, 51: 83, 52: 126, 53: 131, 54: 151, 55: 136, 56: 137, 57: 145, 58: 128, 59: 139, 60: 133, 61: 152, 62: 144, 63: 111, 64: 75, 65: 177, 66: 184,...(truncated), throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
  #23 0x00000000004cdee7 in PyEval_EvalCodeEx (_co=<optimized out>, globals=<optimized out>, locals=locals@entry=0x0, 
      args=<optimized out>, argcount=<optimized out>, kws=kws@entry=0x0, kwcount=kwcount@entry=0, defs=defs@entry=
      0x7fe484218328, defcount=defcount@entry=1, kwdefs=0x0, closure=0x0) at ../Python/ceval.c:3350
  #24 0x00000000004ce9b9 in function_call.62938 (func=<function at remote 0x7fe484219d10>, arg=<optimized out>, 
      kw=<optimized out>) at ../Objects/funcobject.c:629
  #25 0x00000000004a833b in PyObject_Call (func=func@entry=<function at remote 0x7fe484219d10>, arg=arg@entry=
      (<Repository(compact=set(), _active_txn=False, index=None, max_segment_size=5242880, lock=<UpgradableLock(path='/path/to/repository/config', fd=<_io.TextIOWrapper at remote 0x7fe485200a70>, is_exclusive=True) at remote 0x7fe484225110>, segments_per_dir=10000, segments={1: 102, 2: 113, 3: 73, 4: 93, 5: 93, 6: 72, 7: 88, 8: 84, 9: 76, 10: 112, 11: 132, 12: 141, 13: 133, 14: 117, 15: 129, 16: 123, 17: 147, 18: 131, 19: 118, 20: 126, 21: 131, 22: 121, 23: 145, 24: 130, 25: 121, 26: 127, 27: 130, 28: 132, 29: 128, 30: 131, 31: 127, 32: 127, 33: 120, 34: 83, 35: 98, 36: 92, 37: 70, 38: 74, 39: 109, 40: 87, 41: 87, 42: 104, 43: 91, 44: 107, 45: 193, 46: 220, 47: 230, 48: 202, 49: 195, 50: 206, 51: 83, 52: 126, 53: 131, 54: 151, 55: 136, 56: 137, 57: 145, 58: 128, 59: 139, 60: 133, 61: 152, 62: 144, 63: 111, 64: 75, 65: 177, 66: 184, 67: 172, 68: 176, 69: 165, 70: 164, 71: 176, 72: 170, 73: 189, 74: 157, 75: 157, 76: 156, 77: 182, 78: 163, 79: 188, 80: 199, 81: 209, 82: 217, 83: 213, 84:...(truncated), kw=kw@entry=0x0) at ../Objects/abstract.c:2149
  #26 0x00000000004b8d0d in ext_do_call (nk=-2045514000, na=1, flags=<optimized out>, pp_stack=0x7fffb04c0640, func=
      <function at remote 0x7fe484219d10>) at ../Python/ceval.c:4236
  #27 PyEval_EvalFrameEx (f=<optimized out>, throwflag=throwflag@entry=0) at ../Python/ceval.c:2733
  #28 0x00000000004ba36e in fast_function (nk=<optimized out>, na=1, n=<optimized out>, pp_stack=0x7fffb04c07e0, func=
      <function at remote 0x7fe48421f848>) at ../Python/ceval.c:4009
  #29 call_function (oparg=<optimized out>, pp_stack=0x7fffb04c07e0) at ../Python/ceval.c:3942
  #30 PyEval_EvalFrameEx (f=<optimized out>, throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
  #31 0x00000000004ba36e in fast_function (nk=<optimized out>, na=1, n=<optimized out>, pp_stack=0x7fffb04c0990, func=
  ---Type <return> to continue, or q <return> to quit---
      <function at remote 0x7fe48421f738>) at ../Python/ceval.c:4009
  #32 call_function (oparg=<optimized out>, pp_stack=0x7fffb04c0990) at ../Python/ceval.c:3942
  #33 PyEval_EvalFrameEx (f=f@entry=
      Frame 0x27977f0, for file /usr/local/lib/python3.2/dist-packages/Attic-0.10_53_gea70050-py3.2-linux-x86_64.egg/attic/archiver.py, line 414, in run (self=<Archiver(exit_code=0) at remote 0x7fe486277510>, args=['serve'], keys_dir='/home/attic/.attic/keys', cache_dir='/home/attic/.cache/attic', common_parser=<ArgumentParser(_negative_number_matcher=<_sre.SRE_Pattern at remote 0x2ab9c30>, _option_string_actions={'-v': <_StoreTrueAction(const=True, help='verbose output', option_strings=['-v', '--verbose'], dest='verbose', required=False, nargs=0, choices=None, default=False, container=<_ArgumentGroup(_mutually_exclusive_groups=[], _negative_number_matcher=<_sre.SRE_Pattern at remote 0x2ab9c30>, description=None, _option_string_actions={...}, title='optional arguments', _has_negative_number_optionals=[], _defaults={}, prefix_chars='-', argument_default=None, _registries={'action': {'store_false': <type at remote 0x29aea90>, 'append_const': <type at remote 0x29af7b0>, 'help': <type at remote 0x29b0490>, None: <type ...(truncated), throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
  #34 0x00000000004cdee7 in PyEval_EvalCodeEx (_co=<optimized out>, globals=<optimized out>, locals=locals@entry=0x0, 
      args=<optimized out>, argcount=argcount@entry=2, kws=0x2a65310, kwcount=0, defs=0x7fe4842184e8, defcount=1, kwdefs=0x0, 
      closure=0x0) at ../Python/ceval.c:3350
  #35 0x00000000004ba764 in fast_function (nk=<optimized out>, na=2, n=<optimized out>, pp_stack=0x7fffb04c0c00, func=
      <function at remote 0x7fe4842229e0>) at ../Python/ceval.c:4019
  #36 call_function (oparg=<optimized out>, pp_stack=0x7fffb04c0c00) at ../Python/ceval.c:3942
  #37 PyEval_EvalFrameEx (f=<optimized out>, throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
  #38 0x00000000004ba36e in fast_function (nk=<optimized out>, na=0, n=<optimized out>, pp_stack=0x7fffb04c0db0, func=
      <function at remote 0x7fe4846867c0>) at ../Python/ceval.c:4009
  #39 call_function (oparg=<optimized out>, pp_stack=0x7fffb04c0db0) at ../Python/ceval.c:3942
  #40 PyEval_EvalFrameEx (f=f@entry=
      Frame 0x2939ba0, for file /usr/local/lib/python3.2/dist-packages/Attic-0.10_53_gea70050-py3.2-linux-x86_64.egg/EGG-INFO/scripts/attic, line 3, in <module> (), throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
  #41 0x00000000004cdee7 in PyEval_EvalCodeEx (_co=<optimized out>, globals=<optimized out>, locals=<optimized out>, 
      args=args@entry=0x0, argcount=argcount@entry=0, kws=kws@entry=0x0, kwcount=kwcount@entry=0, defs=defs@entry=0x0, 
      defcount=defcount@entry=0, kwdefs=kwdefs@entry=0x0, closure=closure@entry=0x0) at ../Python/ceval.c:3350
  #42 0x0000000000557e2d in PyEval_EvalCode (locals=<optimized out>, globals=<optimized out>, co=<optimized out>)
      at ../Python/ceval.c:767
  #43 builtin_exec (self=<optimized out>, args=<optimized out>) at ../Python/bltinmodule.c:840
  #44 0x00000000004b666f in call_function (oparg=<optimized out>, pp_stack=0x7fffb04c10e0) at ../Python/ceval.c:3921
  #45 PyEval_EvalFrameEx (f=<optimized out>, throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
  #46 0x00000000004ba36e in fast_function (nk=<optimized out>, na=3, n=<optimized out>, pp_stack=0x7fffb04c1290, func=
      <function at remote 0x7fe4862d2628>) at ../Python/ceval.c:4009
  #47 call_function (oparg=<optimized out>, pp_stack=0x7fffb04c1290) at ../Python/ceval.c:3942
  #48 PyEval_EvalFrameEx (f=<optimized out>, throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
  #49 0x00000000004ba36e in fast_function (nk=<optimized out>, na=3, n=<optimized out>, pp_stack=0x7fffb04c1440, func=
  ---Type <return> to continue, or q <return> to quit---
      <function at remote 0x7fe4862a86b0>) at ../Python/ceval.c:4009
  #50 call_function (oparg=<optimized out>, pp_stack=0x7fffb04c1440) at ../Python/ceval.c:3942
  #51 PyEval_EvalFrameEx (f=f@entry=Frame 0x2862c10, for file /usr/local/bin/attic, line 5, in <module> (), 
      throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
  #52 0x00000000004cdee7 in PyEval_EvalCodeEx (_co=_co@entry=<code at remote 0x7fe48637abe0>, globals=globals@entry=
      {'__builtins__': {'bytearray': <type at remote 0x8c83e0>, 'IndexError': <type at remote 0x8bcda0>, 'all': <built-in method all of module object at remote 0x7fe4877e17a0>, 'help': <_Helper at remote 0x7fe486349190>, 'vars': <built-in method vars of module object at remote 0x7fe4877e17a0>, 'SyntaxError': <type at remote 0x8bfb40>, 'UnicodeDecodeError': <type at remote 0x8beb00>, 'memoryview': <type at remote 0x8c7880>, 'isinstance': <built-in method isinstance of module object at remote 0x7fe4877e17a0>, '__build_class__': <built-in method __build_class__ of module object at remote 0x7fe4877e17a0>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2012 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCopyright (c) 1995-2001 Corporation for National Research Initiatives.\nAll Rights Reserved.\n\nCopyright (c) 1991-1995 Stichting Mathematisch Centrum, Amsterdam.\nAll Rights Reserved.', _Printer__lines=None, _Printer__name='copyright', _Printer__di...(truncated), locals=locals@entry=
      {'__builtins__': {'bytearray': <type at remote 0x8c83e0>, 'IndexError': <type at remote 0x8bcda0>, 'all': <built-in method all of module object at remote 0x7fe4877e17a0>, 'help': <_Helper at remote 0x7fe486349190>, 'vars': <built-in method vars of module object at remote 0x7fe4877e17a0>, 'SyntaxError': <type at remote 0x8bfb40>, 'UnicodeDecodeError': <type at remote 0x8beb00>, 'memoryview': <type at remote 0x8c7880>, 'isinstance': <built-in method isinstance of module object at remote 0x7fe4877e17a0>, '__build_class__': <built-in method __build_class__ of module object at remote 0x7fe4877e17a0>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2012 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCopyright (c) 1995-2001 Corporation for National Research Initiatives.\nAll Rights Reserved.\n\nCopyright (c) 1991-1995 Stichting Mathematisch Centrum, Amsterdam.\nAll Rights Reserved.', _Printer__lines=None, _Printer__name='copyright', _Printer__di...(truncated), args=args@entry=0x0, argcount=argcount@entry=0, kws=kws@entry=0x0, 
      kwcount=kwcount@entry=0, defs=defs@entry=0x0, defcount=defcount@entry=0, kwdefs=kwdefs@entry=0x0, closure=closure@entry=
      0x0) at ../Python/ceval.c:3350
  #53 0x00000000005464bf in PyEval_EvalCode (locals=
      {'__builtins__': {'bytearray': <type at remote 0x8c83e0>, 'IndexError': <type at remote 0x8bcda0>, 'all': <built-in method all of module object at remote 0x7fe4877e17a0>, 'help': <_Helper at remote 0x7fe486349190>, 'vars': <built-in method vars of module object at remote 0x7fe4877e17a0>, 'SyntaxError': <type at remote 0x8bfb40>, 'UnicodeDecodeError': <type at remote 0x8beb00>, 'memoryview': <type at remote 0x8c7880>, 'isinstance': <built-in method isinstance of module object at remote 0x7fe4877e17a0>, '__build_class__': <built-in method __build_class__ of module object at remote 0x7fe4877e17a0>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2012 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCopyright (c) 1995-2001 Corporation for National Research Initiatives.\nAll Rights Reserved.\n\nCopyright (c) 1991-1995 Stichting Mathematisch Centrum, Amsterdam.\nAll Rights Reserved.', _Printer__lines=None, _Printer__name='copyright', _Printer__di...(truncated), globals=
      {'__builtins__': {'bytearray': <type at remote 0x8c83e0>, 'IndexError': <type at remote 0x8bcda0>, 'all': <built-in method all of module object at remote 0x7fe4877e17a0>, 'help': <_Helper at remote 0x7fe486349190>, 'vars': <built-in method vars of module object at remote 0x7fe4877e17a0>, 'SyntaxError': <type at remote 0x8bfb40>, 'UnicodeDecodeError': <type at remote 0x---Type <return> to continue, or q <return> to quit---
  8beb00>, 'memoryview': <type at remote 0x8c7880>, 'isinstance': <built-in method isinstance of module object at remote 0x7fe4877e17a0>, '__build_class__': <built-in method __build_class__ of module object at remote 0x7fe4877e17a0>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2012 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCopyright (c) 1995-2001 Corporation for National Research Initiatives.\nAll Rights Reserved.\n\nCopyright (c) 1991-1995 Stichting Mathematisch Centrum, Amsterdam.\nAll Rights Reserved.', _Printer__lines=None, _Printer__name='copyright', _Printer__di...(truncated), co=<code at remote 0x7fe48637abe0>) at ../Python/ceval.c:767
  #54 run_mod (mod=<optimized out>, filename=<optimized out>, globals=
      {'__builtins__': {'bytearray': <type at remote 0x8c83e0>, 'IndexError': <type at remote 0x8bcda0>, 'all': <built-in method all of module object at remote 0x7fe4877e17a0>, 'help': <_Helper at remote 0x7fe486349190>, 'vars': <built-in method vars of module object at remote 0x7fe4877e17a0>, 'SyntaxError': <type at remote 0x8bfb40>, 'UnicodeDecodeError': <type at remote 0x8beb00>, 'memoryview': <type at remote 0x8c7880>, 'isinstance': <built-in method isinstance of module object at remote 0x7fe4877e17a0>, '__build_class__': <built-in method __build_class__ of module object at remote 0x7fe4877e17a0>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2012 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCopyright (c) 1995-2001 Corporation for National Research Initiatives.\nAll Rights Reserved.\n\nCopyright (c) 1991-1995 Stichting Mathematisch Centrum, Amsterdam.\nAll Rights Reserved.', _Printer__lines=None, _Printer__name='copyright', _Printer__di...(truncated), locals=
      {'__builtins__': {'bytearray': <type at remote 0x8c83e0>, 'IndexError': <type at remote 0x8bcda0>, 'all': <built-in method all of module object at remote 0x7fe4877e17a0>, 'help': <_Helper at remote 0x7fe486349190>, 'vars': <built-in method vars of module object at remote 0x7fe4877e17a0>, 'SyntaxError': <type at remote 0x8bfb40>, 'UnicodeDecodeError': <type at remote 0x8beb00>, 'memoryview': <type at remote 0x8c7880>, 'isinstance': <built-in method isinstance of module object at remote 0x7fe4877e17a0>, '__build_class__': <built-in method __build_class__ of module object at remote 0x7fe4877e17a0>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2012 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCopyright (c) 1995-2001 Corporation for National Research Initiatives.\nAll Rights Reserved.\n\nCopyright (c) 1991-1995 Stichting Mathematisch Centrum, Amsterdam.\nAll Rights Reserved.', _Printer__lines=None, _Printer__name='copyright', _Printer__di...(truncated), flags=<optimized out>, arena=<optimized out>) at ../Python/pythonrun.c:1828
  #55 0x000000000045420c in PyRun_FileExFlags (fp=fp@entry=0x286fb20, filename=filename@entry=
      0x7fe486346c20 "/usr/local/bin/attic", start=start@entry=257, globals=globals@entry=
      {'__builtins__': {'bytearray': <type at remote 0x8c83e0>, 'IndexError': <type at remote 0x8bcda0>, 'all': <built-in method all of module object at remote 0x7fe4877e17a0>, 'help': <_Helper at remote 0x7fe486349190>, 'vars': <built-in method vars of module object at remote 0x7fe4877e17a0>, 'SyntaxError': <type at remote 0x8bfb40>, 'UnicodeDecodeError': <type at remote 0x8beb00>, 'memoryview': <type at remote 0x8c7880>, 'isinstance': <built-in method isinstance of module object at remote 0x7fe4877e17a0>, '__build_class__': <built-in method __build_class__ of module object at remote 0x7fe4877e17a0>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2012 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCopyright (c) 1995-2001 Corporation for National Research Initiatives.\nAll Rights Reserved.\n\nCopyright (c) 1991-1995 Stichting Mathematisch Centrum, Amsterdam.\nAll Rights Reserved.', _Printer__lines=None, _Printer__name='copyright', _Printer__di...(truncated), locals=locals@entry=
      {'__builtins__': {'bytearray': <type at remote 0x8c83e0>, 'IndexError': <type at remote 0x8bcda0>, 'all': <built-in method all of module object at remote 0x7fe4877e17a0>, 'help': <_Helper at remote 0x7fe486349190>, 'vars': <built-in method vars o---Type <return> to continue, or q <return> to quit---
  f module object at remote 0x7fe4877e17a0>, 'SyntaxError': <type at remote 0x8bfb40>, 'UnicodeDecodeError': <type at remote 0x8beb00>, 'memoryview': <type at remote 0x8c7880>, 'isinstance': <built-in method isinstance of module object at remote 0x7fe4877e17a0>, '__build_class__': <built-in method __build_class__ of module object at remote 0x7fe4877e17a0>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2012 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCopyright (c) 1995-2001 Corporation for National Research Initiatives.\nAll Rights Reserved.\n\nCopyright (c) 1991-1995 Stichting Mathematisch Centrum, Amsterdam.\nAll Rights Reserved.', _Printer__lines=None, _Printer__name='copyright', _Printer__di...(truncated), closeit=closeit@entry=1, flags=flags@entry=0x7fffb04c1700)
      at ../Python/pythonrun.c:1785
  #56 0x000000000045452c in PyRun_SimpleFileExFlags (fp=fp@entry=0x286fb20, filename=<optimized out>, 
      closeit=closeit@entry=1, flags=flags@entry=0x7fffb04c1700) at ../Python/pythonrun.c:1299
  #57 0x00000000004545f3 in PyRun_AnyFileExFlags (fp=fp@entry=0x286fb20, filename=<optimized out>, closeit=closeit@entry=1, 
      flags=flags@entry=0x7fffb04c1700) at ../Python/pythonrun.c:1068
  #58 0x00000000005587b5 in run_file (p_cf=0x7fffb04c1700, filename=0x26f82a0 L"/usr/local/bin/attic", fp=0x286fb20)
      at ../Modules/main.c:307
  #59 Py_Main (argc=argc@entry=3, argv=argv@entry=0x26f7010) at ../Modules/main.c:733
  #60 0x00000000004616eb in main (argc=3, argv=0x7fffb04c1918) at ../Modules/python.c:65

position 2:

Python stack:
  File "/usr/local/lib/python3.2/dist-packages/Attic-0.10_53_gea70050-py3.2-linux-x86_64.egg/attic/repository.py", line 172, in lookup
    return tag == TAG_PUT and self.index.get(key, (-1, -1))[0] == segment
  File "/usr/local/lib/python3.2/dist-packages/Attic-0.10_53_gea70050-py3.2-linux-x86_64.egg/attic/repository.py", line 462, in iter_objects
    if not lookup or lookup(tag, key):
  File "/usr/local/lib/python3.2/dist-packages/Attic-0.10_53_gea70050-py3.2-linux-x86_64.egg/attic/repository.py", line 176, in compact_segments
    for tag, key, data in self.io.iter_objects(segment, lookup, include_data=True):
  File "/usr/local/lib/python3.2/dist-packages/Attic-0.10_53_gea70050-py3.2-linux-x86_64.egg/attic/repository.py", line 121, in commit
    self.compact_segments()
  (frame information optimized out)
  (frame information optimized out)
  File "/usr/local/lib/python3.2/dist-packages/Attic-0.10_53_gea70050-py3.2-linux-x86_64.egg/attic/archiver.py", line 414, in run
    return self.do_serve()
  (frame information optimized out)
  File "/usr/local/lib/python3.2/dist-packages/Attic-0.10_53_gea70050-py3.2-linux-x86_64.egg/EGG-INFO/scripts/attic", line 3, in <module>
    main()
  (frame information optimized out)
  (frame information optimized out)
  File "/usr/local/bin/attic", line 5, in <module>
    pkg_resources.run_script('Attic==0.10-53-gea70050', 'attic')

C stack:
  #0  0x00007fe484245f10 in hashindex_lookup (index=index@entry=0x2ab7a50, key=0x31d9c68) at attic/_hashindex.c:89
  #1  0x00007fe484245fb9 in hashindex_get (index=0x2ab7a50, key=<optimized out>) at attic/_hashindex.c:315
  #2  0x00007fe4842482bb in __pyx_pf_5attic_9hashindex_7NSIndex___getitem__ (__pyx_v_key=
      b'\x12\xe1\xb9\xf8\xca\xa8\xb5\xd6[\x9a\xf7\xfb\xfb:\x9a\x16\x8bZ\x89\x00\xbe\xf3\xdbJ\x05\x8a\x01\x03Q\x88 \x9c', 
      __pyx_v_self=<optimized out>) at attic/hashindex.c:2161
  #3  __pyx_pw_5attic_9hashindex_7NSIndex_1__getitem__ (__pyx_v_self=<attic.hashindex.NSIndex at remote 0x3951558>, 
      __pyx_v_key=
      b'\x12\xe1\xb9\xf8\xca\xa8\xb5\xd6[\x9a\xf7\xfb\xfb:\x9a\x16\x8bZ\x89\x00\xbe\xf3\xdbJ\x05\x8a\x01\x03Q\x88 \x9c')
      at attic/hashindex.c:2110
  #4  0x00007fe48424719f in __pyx_pf_5attic_9hashindex_9IndexBase_14get (__pyx_v_default=(-1, -1), 
      __pyx_v_key=<optimized out>, __pyx_v_self=0x3951558) at attic/hashindex.c:1725
  #5  __pyx_pw_5attic_9hashindex_9IndexBase_15get (__pyx_v_self=<attic.hashindex.NSIndex at remote 0x3951558>, 
      __pyx_args=<optimized out>, __pyx_kwds=<optimized out>) at attic/hashindex.c:1683
  #6  0x00000000004b666f in call_function (oparg=<optimized out>, pp_stack=0x7fffb04bfc40) at ../Python/ceval.c:3921
  #7  PyEval_EvalFrameEx (f=f@entry=
      Frame 0x2ad4c10, for file /usr/local/lib/python3.2/dist-packages/Attic-0.10_53_gea70050-py3.2-linux-x86_64.egg/attic/repository.py, line 172, in lookup (tag=0, key=b'\x12\xe1\xb9\xf8\xca\xa8\xb5\xd6[\x9a\xf7\xfb\xfb:\x9a\x16\x8bZ\x89\x00\xbe\xf3\xdbJ\x05\x8a\x01\x03Q\x88 \x9c'), throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
  #8  0x00000000004cdee7 in PyEval_EvalCodeEx (_co=<optimized out>, globals=<optimized out>, locals=locals@entry=0x0, 
      args=<optimized out>, argcount=argcount@entry=2, kws=0x2ad4bc0, kwcount=0, defs=0x0, defcount=0, kwdefs=0x0, closure=
      (<cell at remote 0x3975440>, <cell at remote 0x31b07f8>)) at ../Python/ceval.c:3350
  #9  0x00000000004ba764 in fast_function (nk=<optimized out>, na=2, n=<optimized out>, pp_stack=0x7fffb04bfeb0, func=
      <function at remote 0x7fe484222b78>) at ../Python/ceval.c:4019
  #10 call_function (oparg=<optimized out>, pp_stack=0x7fffb04bfeb0) at ../Python/ceval.c:3942
  #11 PyEval_EvalFrameEx (f=f@entry=
      Frame 0x2ad49d0, for file /usr/local/lib/python3.2/dist-packages/Attic-0.10_53_gea70050-py3.2-linux-x86_64.egg/attic/repository.py, line 462, in iter_objects (self=<LoggedIO(segments_per_dir=10000, fds=<LRUCache(_lru=[43665, 43666, 43667, 43669, 43670, 43671, 43672, 43673, 43674, 43676, 43677, 43678, 43679, 43681, 43682, 43683, 43684, 43686, 43687, 43688, 43689, 43690, 43691, 43693, 43694, 43695, 43696, 43698, 43699, 43700, 43701, 43703, 43704, 43705, 43706, 43707, 43708, 43710, 43711, 43712, 43713, 43715, 43716, 43717, 43718, 43720, 43721, 43722, 43723, 43724, 43725, 43727, 43728, 43729, 43730, 43732, 43733, 43734, 43735, 43737, 43738, 43739, 43740, 43741, 43742, 43744, 43745, 43746, 43747, 43749, 43750, 43751, 43752, 43754, 43755, 43756, 43757, 43758, 43759, 43761, 43762, 43763, 43764, 43766, 43767, 43768, 43769, 43771, 43772, 43773], _capacity=90) at remote 0x2ace8c0>, limit=5242880, offset=88831, _write_fd=<_io.BufferedWriter at remote 0x7fe484237330>, path='/path/to/repos....(truncated), throwflag=<optimized out>) at ../Python/ceval.c:2692
  #12 0x00000000004cd9b5 in gen_send_ex.isra.1 (arg=0x0, exc=<optimized out>) at ../Objects/genobject.c:82
  #13 0x00000000004b68de in PyEval_EvalFrameEx (f=f@entry=
      Frame 0x2ad47a0, for file /usr/local/lib/python3.2/dist-packages/Attic-0.10_53_gea70050-py3.2-linux-x86_64.egg/attic/repository.py, line 176, in compact_segments (self=<Repository(compact={43773, 43774}, _active_txn=True, index=<attic.hashindex.N---Type <return> to continue, or q <return> to quit---
  SIndex at remote 0x3951558>, max_segment_size=5242880, lock=<UpgradableLock(path='/path/to/repository/config', fd=<_io.TextIOWrapper at remote 0x7fe485200a70>, is_exclusive=True) at remote 0x7fe484225110>, segments_per_dir=10000, segments={1: 102, 2: 113, 3: 73, 4: 93, 5: 93, 6: 72, 7: 88, 8: 84, 9: 76, 10: 112, 11: 132, 12: 141, 13: 133, 14: 117, 15: 129, 16: 123, 17: 147, 18: 131, 19: 118, 20: 126, 21: 131, 22: 121, 23: 145, 24: 130, 25: 121, 26: 127, 27: 130, 28: 132, 29: 128, 30: 131, 31: 127, 32: 127, 33: 120, 34: 83, 35: 98, 36: 92, 37: 70, 38: 74, 39: 109, 40: 87, 41: 87, 42: 104, 43: 91, 44: 107, 45: 193, 46: 220, 47: 230, 48: 202, 49: 195, 50: 206, 51: 83, 52: 126, 53: 131, 54: 151, 55: 136, 56: 137, 57: 145, 58: 128, 59: 139, 60...(truncated), throwflag=throwflag@entry=0) at ../Python/ceval.c:2515
  #14 0x00000000004cdee7 in PyEval_EvalCodeEx (_co=<optimized out>, globals=<optimized out>, locals=locals@entry=0x0, 
      args=<optimized out>, argcount=argcount@entry=1, kws=0x2ad4578, kwcount=0, defs=0x0, defcount=0, kwdefs=0x0, closure=
      0x0) at ../Python/ceval.c:3350
  #15 0x00000000004ba764 in fast_function (nk=<optimized out>, na=1, n=<optimized out>, pp_stack=0x7fffb04c0310, func=
      <function at remote 0x7fe4842198d0>) at ../Python/ceval.c:4019
  #16 call_function (oparg=<optimized out>, pp_stack=0x7fffb04c0310) at ../Python/ceval.c:3942
  #17 PyEval_EvalFrameEx (f=f@entry=
      Frame 0x2ad43f0, for file /usr/local/lib/python3.2/dist-packages/Attic-0.10_53_gea70050-py3.2-linux-x86_64.egg/attic/repository.py, line 121, in commit (self=<Repository(compact={43773, 43774}, _active_txn=True, index=<attic.hashindex.NSIndex at remote 0x3951558>, max_segment_size=5242880, lock=<UpgradableLock(path='/path/to/repository/config', fd=<_io.TextIOWrapper at remote 0x7fe485200a70>, is_exclusive=True) at remote 0x7fe484225110>, segments_per_dir=10000, segments={1: 102, 2: 113, 3: 73, 4: 93, 5: 93, 6: 72, 7: 88, 8: 84, 9: 76, 10: 112, 11: 132, 12: 141, 13: 133, 14: 117, 15: 129, 16: 123, 17: 147, 18: 131, 19: 118, 20: 126, 21: 131, 22: 121, 23: 145, 24: 130, 25: 121, 26: 127, 27: 130, 28: 132, 29: 128, 30: 131, 31: 127, 32: 127, 33: 120, 34: 83, 35: 98, 36: 92, 37: 70, 38: 74, 39: 109, 40: 87, 41: 87, 42: 104, 43: 91, 44: 107, 45: 193, 46: 220, 47: 230, 48: 202, 49: 195, 50: 206, 51: 83, 52: 126, 53: 131, 54: 151, 55: 136, 56: 137, 57: 145, 58: 128, 59: 139, 60: 133, 61:...(truncated), throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
  #18 0x00000000004cdee7 in PyEval_EvalCodeEx (_co=<optimized out>, globals=<optimized out>, locals=locals@entry=0x0, 
      args=<optimized out>, argcount=<optimized out>, kws=kws@entry=0x0, kwcount=kwcount@entry=0, defs=defs@entry=0x0, 
      defcount=defcount@entry=0, kwdefs=0x0, closure=0x0) at ../Python/ceval.c:3350
  #19 0x00000000004ce9b9 in function_call.62938 (func=<function at remote 0x7fe484212270>, arg=<optimized out>, 
      kw=<optimized out>) at ../Objects/funcobject.c:629
  #20 0x00000000004a833b in PyObject_Call (func=func@entry=<function at remote 0x7fe484212270>, arg=arg@entry=
      (<Repository(compact={43773, 43774}, _active_txn=True, index=<attic.hashindex.NSIndex at remote 0x3951558>, max_segment_size=5242880, lock=<UpgradableLock(path='/path/to/repository/config', fd=<_io.TextIOWrapper at remote 0x7fe485200a70>, is_exclusive=True) at remote 0x7fe484225110>, segments_per_dir=10000, segments={1: 102, 2: 113, 3: 73, 4: 93, 5: 93, 6: 72, 7: 88, 8: 84, 9: 76, 10: 112, 11: 132, 12: 141, 13: 133, 14: 117, 15: 129, 16: 123, 17: 147, 18: 131, 19: 118, 20: 126, 21: 131, 22: 121, 23: 145, 24: 130, 25: 121, 26: 127, 27: 130, 28: 132, 29: 128, 30: 131, 31: 127, 32: 127, 33: 120, 34: 83, 35: 98, 36: 92, 37: 70, 38: 74, 39: 109, 40: 87, 41: 87, 42: 104, 43: 91, 44: 107, 45: 193, 46: 220, 47: 230, 48: 202, 49: 195, 50: 206, 51: 83, 52: 126, 53: 131, 54: 151, 55: 136, 56: 137, 57: 145, 58: 128, 59: 139, 60: 133, 61: 152, 62: 144, 63: 111, 64: 75, 65: 177, 66: 184, 67: 172, 68: 176, 69: 165, 70: 164, 71: 176, 72: 170, 73: 189, 74: 157, 75: 157, 76: 156, 77: 182, 78: 163,...(truncated), kw=kw@entry=0x0) at ../Objects/abstract.c:2149
  ---Type <return> to continue, or q <return> to quit---
  #21 0x00000000004b8d0d in ext_do_call (nk=-2044269744, na=1, flags=<optimized out>, pp_stack=0x7fffb04c0640, func=
      <function at remote 0x7fe484212270>) at ../Python/ceval.c:4236
  #22 PyEval_EvalFrameEx (f=<optimized out>, throwflag=throwflag@entry=0) at ../Python/ceval.c:2733
  #23 0x00000000004ba36e in fast_function (nk=<optimized out>, na=1, n=<optimized out>, pp_stack=0x7fffb04c07e0, func=
      <function at remote 0x7fe48421f848>) at ../Python/ceval.c:4009
  #24 call_function (oparg=<optimized out>, pp_stack=0x7fffb04c07e0) at ../Python/ceval.c:3942
  #25 PyEval_EvalFrameEx (f=<optimized out>, throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
  #26 0x00000000004ba36e in fast_function (nk=<optimized out>, na=1, n=<optimized out>, pp_stack=0x7fffb04c0990, func=
      <function at remote 0x7fe48421f738>) at ../Python/ceval.c:4009
  #27 call_function (oparg=<optimized out>, pp_stack=0x7fffb04c0990) at ../Python/ceval.c:3942
  #28 PyEval_EvalFrameEx (f=f@entry=
      Frame 0x27977f0, for file /usr/local/lib/python3.2/dist-packages/Attic-0.10_53_gea70050-py3.2-linux-x86_64.egg/attic/archiver.py, line 414, in run (self=<Archiver(exit_code=0) at remote 0x7fe486277510>, args=['serve'], keys_dir='/home/attic/.attic/keys', cache_dir='/home/attic/.cache/attic', common_parser=<ArgumentParser(_negative_number_matcher=<_sre.SRE_Pattern at remote 0x2ab9c30>, _option_string_actions={'-v': <_StoreTrueAction(const=True, help='verbose output', option_strings=['-v', '--verbose'], dest='verbose', required=False, nargs=0, choices=None, default=False, container=<_ArgumentGroup(_mutually_exclusive_groups=[], _negative_number_matcher=<_sre.SRE_Pattern at remote 0x2ab9c30>, description=None, _option_string_actions={...}, title='optional arguments', _has_negative_number_optionals=[], _defaults={}, prefix_chars='-', argument_default=None, _registries={'action': {'store_false': <type at remote 0x29aea90>, 'append_const': <type at remote 0x29af7b0>, 'help': <type at remote 0x29b0490>, None: <type ...(truncated), throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
  #29 0x00000000004cdee7 in PyEval_EvalCodeEx (_co=<optimized out>, globals=<optimized out>, locals=locals@entry=0x0, 
      args=<optimized out>, argcount=argcount@entry=2, kws=0x2a65310, kwcount=0, defs=0x7fe4842184e8, defcount=1, kwdefs=0x0, 
      closure=0x0) at ../Python/ceval.c:3350
  #30 0x00000000004ba764 in fast_function (nk=<optimized out>, na=2, n=<optimized out>, pp_stack=0x7fffb04c0c00, func=
      <function at remote 0x7fe4842229e0>) at ../Python/ceval.c:4019
  #31 call_function (oparg=<optimized out>, pp_stack=0x7fffb04c0c00) at ../Python/ceval.c:3942
  #32 PyEval_EvalFrameEx (f=<optimized out>, throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
  #33 0x00000000004ba36e in fast_function (nk=<optimized out>, na=0, n=<optimized out>, pp_stack=0x7fffb04c0db0, func=
      <function at remote 0x7fe4846867c0>) at ../Python/ceval.c:4009
  #34 call_function (oparg=<optimized out>, pp_stack=0x7fffb04c0db0) at ../Python/ceval.c:3942
  #35 PyEval_EvalFrameEx (f=f@entry=
      Frame 0x2939ba0, for file /usr/local/lib/python3.2/dist-packages/Attic-0.10_53_gea70050-py3.2-linux-x86_64.egg/EGG-INFO/scripts/attic, line 3, in <module> (), throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
  #36 0x00000000004cdee7 in PyEval_EvalCodeEx (_co=<optimized out>, globals=<optimized out>, locals=<optimized out>, 
      args=args@entry=0x0, argcount=argcount@entry=0, kws=kws@entry=0x0, kwcount=kwcount@entry=0, defs=defs@entry=0x0, 
      defcount=defcount@entry=0, kwdefs=kwdefs@entry=0x0, closure=closure@entry=0x0) at ../Python/ceval.c:3350
  #37 0x0000000000557e2d in PyEval_EvalCode (locals=<optimized out>, globals=<optimized out>, co=<optimized out>)
      at ../Python/ceval.c:767
  ---Type <return> to continue, or q <return> to quit---
  #38 builtin_exec (self=<optimized out>, args=<optimized out>) at ../Python/bltinmodule.c:840
  #39 0x00000000004b666f in call_function (oparg=<optimized out>, pp_stack=0x7fffb04c10e0) at ../Python/ceval.c:3921
  #40 PyEval_EvalFrameEx (f=<optimized out>, throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
  #41 0x00000000004ba36e in fast_function (nk=<optimized out>, na=3, n=<optimized out>, pp_stack=0x7fffb04c1290, func=
      <function at remote 0x7fe4862d2628>) at ../Python/ceval.c:4009
  #42 call_function (oparg=<optimized out>, pp_stack=0x7fffb04c1290) at ../Python/ceval.c:3942
  #43 PyEval_EvalFrameEx (f=<optimized out>, throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
  #44 0x00000000004ba36e in fast_function (nk=<optimized out>, na=3, n=<optimized out>, pp_stack=0x7fffb04c1440, func=
      <function at remote 0x7fe4862a86b0>) at ../Python/ceval.c:4009
  #45 call_function (oparg=<optimized out>, pp_stack=0x7fffb04c1440) at ../Python/ceval.c:3942
  #46 PyEval_EvalFrameEx (f=f@entry=Frame 0x2862c10, for file /usr/local/bin/attic, line 5, in <module> (), 
      throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
  #47 0x00000000004cdee7 in PyEval_EvalCodeEx (_co=_co@entry=<code at remote 0x7fe48637abe0>, globals=globals@entry=
      {'__builtins__': {'bytearray': <type at remote 0x8c83e0>, 'IndexError': <type at remote 0x8bcda0>, 'all': <built-in method all of module object at remote 0x7fe4877e17a0>, 'help': <_Helper at remote 0x7fe486349190>, 'vars': <built-in method vars of module object at remote 0x7fe4877e17a0>, 'SyntaxError': <type at remote 0x8bfb40>, 'UnicodeDecodeError': <type at remote 0x8beb00>, 'memoryview': <type at remote 0x8c7880>, 'isinstance': <built-in method isinstance of module object at remote 0x7fe4877e17a0>, '__build_class__': <built-in method __build_class__ of module object at remote 0x7fe4877e17a0>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2012 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCopyright (c) 1995-2001 Corporation for National Research Initiatives.\nAll Rights Reserved.\n\nCopyright (c) 1991-1995 Stichting Mathematisch Centrum, Amsterdam.\nAll Rights Reserved.', _Printer__lines=None, _Printer__name='copyright', _Printer__di...(truncated), locals=locals@entry=
      {'__builtins__': {'bytearray': <type at remote 0x8c83e0>, 'IndexError': <type at remote 0x8bcda0>, 'all': <built-in method all of module object at remote 0x7fe4877e17a0>, 'help': <_Helper at remote 0x7fe486349190>, 'vars': <built-in method vars of module object at remote 0x7fe4877e17a0>, 'SyntaxError': <type at remote 0x8bfb40>, 'UnicodeDecodeError': <type at remote 0x8beb00>, 'memoryview': <type at remote 0x8c7880>, 'isinstance': <built-in method isinstance of module object at remote 0x7fe4877e17a0>, '__build_class__': <built-in method __build_class__ of module object at remote 0x7fe4877e17a0>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2012 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCopyright (c) 1995-2001 Corporation for National Research Initiatives.\nAll Rights Reserved.\n\nCopyright (c) 1991-1995 Stichting Mathematisch Centrum, Amsterdam.\nAll Rights Reserved.', _Printer__lines=None, _Printer__name='copyright', _Printer__di...(truncated), args=args@entry=0x0, argcount=argcount@entry=0, kws=kws@entry=0x0, 
      kwcount=kwcount@entry=0, defs=defs@entry=0x0, defcount=defcount@entry=0, kwdefs=kwdefs@entry=0x0, closure=closure@entry=
      0x0) at ../Python/ceval.c:3350
  #48 0x00000000005464bf in PyEval_EvalCode (locals=
      {'__builtins__': {'bytearray': <type at remote 0x8c83e0>, 'IndexError': <type at remote 0x8bcda0>, 'all': <built-in method all of module object at remote 0x7fe4877e17a0>, 'help': <_Helper at remote 0x7fe486349190>, 'vars': <built-in method vars of module object at remote 0x7fe4877e17a0>, 'SyntaxError': <type at remote 0x8bfb40>, 'UnicodeDecodeError': <type at remote 0x8beb00>, 'memoryview': <type at remote 0x8c7880>, 'isinstance': <built-in method isinstance of module object at remote 0x7fe4---Type <return> to continue, or q <return> to quit---
  877e17a0>, '__build_class__': <built-in method __build_class__ of module object at remote 0x7fe4877e17a0>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2012 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCopyright (c) 1995-2001 Corporation for National Research Initiatives.\nAll Rights Reserved.\n\nCopyright (c) 1991-1995 Stichting Mathematisch Centrum, Amsterdam.\nAll Rights Reserved.', _Printer__lines=None, _Printer__name='copyright', _Printer__di...(truncated), globals=
      {'__builtins__': {'bytearray': <type at remote 0x8c83e0>, 'IndexError': <type at remote 0x8bcda0>, 'all': <built-in method all of module object at remote 0x7fe4877e17a0>, 'help': <_Helper at remote 0x7fe486349190>, 'vars': <built-in method vars of module object at remote 0x7fe4877e17a0>, 'SyntaxError': <type at remote 0x8bfb40>, 'UnicodeDecodeError': <type at remote 0x8beb00>, 'memoryview': <type at remote 0x8c7880>, 'isinstance': <built-in method isinstance of module object at remote 0x7fe4877e17a0>, '__build_class__': <built-in method __build_class__ of module object at remote 0x7fe4877e17a0>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2012 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCopyright (c) 1995-2001 Corporation for National Research Initiatives.\nAll Rights Reserved.\n\nCopyright (c) 1991-1995 Stichting Mathematisch Centrum, Amsterdam.\nAll Rights Reserved.', _Printer__lines=None, _Printer__name='copyright', _Printer__di...(truncated), co=<code at remote 0x7fe48637abe0>) at ../Python/ceval.c:767
  #49 run_mod (mod=<optimized out>, filename=<optimized out>, globals=
      {'__builtins__': {'bytearray': <type at remote 0x8c83e0>, 'IndexError': <type at remote 0x8bcda0>, 'all': <built-in method all of module object at remote 0x7fe4877e17a0>, 'help': <_Helper at remote 0x7fe486349190>, 'vars': <built-in method vars of module object at remote 0x7fe4877e17a0>, 'SyntaxError': <type at remote 0x8bfb40>, 'UnicodeDecodeError': <type at remote 0x8beb00>, 'memoryview': <type at remote 0x8c7880>, 'isinstance': <built-in method isinstance of module object at remote 0x7fe4877e17a0>, '__build_class__': <built-in method __build_class__ of module object at remote 0x7fe4877e17a0>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2012 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCopyright (c) 1995-2001 Corporation for National Research Initiatives.\nAll Rights Reserved.\n\nCopyright (c) 1991-1995 Stichting Mathematisch Centrum, Amsterdam.\nAll Rights Reserved.', _Printer__lines=None, _Printer__name='copyright', _Printer__di...(truncated), locals=
      {'__builtins__': {'bytearray': <type at remote 0x8c83e0>, 'IndexError': <type at remote 0x8bcda0>, 'all': <built-in method all of module object at remote 0x7fe4877e17a0>, 'help': <_Helper at remote 0x7fe486349190>, 'vars': <built-in method vars of module object at remote 0x7fe4877e17a0>, 'SyntaxError': <type at remote 0x8bfb40>, 'UnicodeDecodeError': <type at remote 0x8beb00>, 'memoryview': <type at remote 0x8c7880>, 'isinstance': <built-in method isinstance of module object at remote 0x7fe4877e17a0>, '__build_class__': <built-in method __build_class__ of module object at remote 0x7fe4877e17a0>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2012 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCopyright (c) 1995-2001 Corporation for National Research Initiatives.\nAll Rights Reserved.\n\nCopyright (c) 1991-1995 Stichting Mathematisch Centrum, Amsterdam.\nAll Rights Reserved.', _Printer__lines=None, _Printer__name='copyright', _Printer__di...(truncated), flags=<optimized out>, arena=<optimized out>) at ../Python/pythonrun.c:1828
  #50 0x000000000045420c in PyRun_FileExFlags (fp=fp@entry=0x286fb20, filename=filename@entry=
      0x7fe486346c20 "/usr/local/bin/attic", start=start@entry=257, globals=globals@entry=
      {'__builtins__': {'bytearray': <type at remote 0x8c83e0>, 'IndexError': <type at remote 0x8bcda0>, 'all': <built-in method all of module object at remote 0x7fe4877e17a0>, 'help': <_Helper at remote 0x7fe486349190>, 'vars': <built-in method vars of module object at remote 0x7fe4877e17a0>, 'SyntaxError': <type at remote 0x8bfb40>, 'UnicodeDecodeError': <type at remote 0x---Type <return> to continue, or q <return> to quit---
  8beb00>, 'memoryview': <type at remote 0x8c7880>, 'isinstance': <built-in method isinstance of module object at remote 0x7fe4877e17a0>, '__build_class__': <built-in method __build_class__ of module object at remote 0x7fe4877e17a0>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2012 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCopyright (c) 1995-2001 Corporation for National Research Initiatives.\nAll Rights Reserved.\n\nCopyright (c) 1991-1995 Stichting Mathematisch Centrum, Amsterdam.\nAll Rights Reserved.', _Printer__lines=None, _Printer__name='copyright', _Printer__di...(truncated), locals=locals@entry=
      {'__builtins__': {'bytearray': <type at remote 0x8c83e0>, 'IndexError': <type at remote 0x8bcda0>, 'all': <built-in method all of module object at remote 0x7fe4877e17a0>, 'help': <_Helper at remote 0x7fe486349190>, 'vars': <built-in method vars of module object at remote 0x7fe4877e17a0>, 'SyntaxError': <type at remote 0x8bfb40>, 'UnicodeDecodeError': <type at remote 0x8beb00>, 'memoryview': <type at remote 0x8c7880>, 'isinstance': <built-in method isinstance of module object at remote 0x7fe4877e17a0>, '__build_class__': <built-in method __build_class__ of module object at remote 0x7fe4877e17a0>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2012 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCopyright (c) 1995-2001 Corporation for National Research Initiatives.\nAll Rights Reserved.\n\nCopyright (c) 1991-1995 Stichting Mathematisch Centrum, Amsterdam.\nAll Rights Reserved.', _Printer__lines=None, _Printer__name='copyright', _Printer__di...(truncated), closeit=closeit@entry=1, flags=flags@entry=0x7fffb04c1700)
      at ../Python/pythonrun.c:1785
  #51 0x000000000045452c in PyRun_SimpleFileExFlags (fp=fp@entry=0x286fb20, filename=<optimized out>, 
      closeit=closeit@entry=1, flags=flags@entry=0x7fffb04c1700) at ../Python/pythonrun.c:1299
  #52 0x00000000004545f3 in PyRun_AnyFileExFlags (fp=fp@entry=0x286fb20, filename=<optimized out>, closeit=closeit@entry=1, 
      flags=flags@entry=0x7fffb04c1700) at ../Python/pythonrun.c:1068
  #53 0x00000000005587b5 in run_file (p_cf=0x7fffb04c1700, filename=0x26f82a0 L"/usr/local/bin/attic", fp=0x286fb20)
      at ../Modules/main.c:307
  #54 Py_Main (argc=argc@entry=3, argv=argv@entry=0x26f7010) at ../Modules/main.c:733
  #55 0x00000000004616eb in main (argc=3, argv=0x7fffb04c1918) at ../Modules/python.c:65

On the data source host I am running Attic 0.10_50_g052e4f2-py3.3-linux-x86_64.egg, on the remote repository host I am running Attic 0.10_53_gea70050-py3.2-linux-x86_64.egg

I can do whatever can be done inside gdb, so If the above information is not useful enough and you can think of setting a breakpoint or doing some other trick that may help to better understand what is going on, let me know.

[jborg]

If I'm reading the tracebacks correctly what we're seeing is Attic doing a checkpoint commit. A checkpoint commit is done every 5 minutes to ensure that not all uploaded data is lost if Attic would crash before finishing the archive.

That's all well and good but as you described the progress seems very slow and even a tiny file takes 6 minutes to complete. That tells me two things:

1. There is not 5 minutes of "normal activity" between each checkpoint commit, there's 5 minutes between the start of each checkpoint commit. That's not the same thing, especially if it takes long to perform the actual commit. I've fixed that in commit 9dce236.
2. The commit operations that is supposed to take only a few seconds actually takes 6 minutes. That one I can't really explain, It shouldn't take much longer than the amount of time it takes to copy the "index.X" file, I guess around 100MB in your case. Is the remote machine swapping or really low on ram?

[Ernest0x]

I installed the latest commit 66a84c0 on both the data source host and the remote repository host, I stopped the previous attic create process and started a new one (on same repository and archive). The transferring of new (or modified) files is still slow. Breaking the execution on gdb now results most of the time either in the __read_nocancel() call as before or at one of the following positions:

position 1:

(gdb) py-bt
Traceback (most recent call first):
  File "/usr/local/lib/python3.2/dist-packages/Attic-0.10_73_g66a84c0-py3.2-linux-x86_64.egg/attic/repository.py", line 351, in put
    segment, _ = self.index[id]
  (frame information optimized out)
  (frame information optimized out)
  File "/usr/local/lib/python3.2/dist-packages/Attic-0.10_73_g66a84c0-py3.2-linux-x86_64.egg/attic/archiver.py", line 417, in run
    return self.do_serve()
  (frame information optimized out)
  File "/usr/local/lib/python3.2/dist-packages/Attic-0.10_73_g66a84c0-py3.2-linux-x86_64.egg/EGG-INFO/scripts/attic", line 3, in <module>
    main()
  (frame information optimized out)
  (frame information optimized out)
  File "/usr/local/bin/attic", line 5, in <module>
    pkg_resources.run_script('Attic==0.10-73-g66a84c0', 'attic')

(gdb) bt
#0  0x00007f25d0d88f10 in hashindex_lookup (index=index@entry=0x22a7130, key=0x7f25d0d68e18) at attic/_hashindex.c:89
#1  0x00007f25d0d88fb9 in hashindex_get (index=0x22a7130, key=<optimized out>) at attic/_hashindex.c:315
#2  0x00007f25d0d8b2bb in __pyx_pf_5attic_9hashindex_7NSIndex___getitem__ (__pyx_v_key=b'\x1d>\xb7Y\xf9\x11\xd8\xde\xbc\xbft\nhz\xe8?A%\x8b\x8dM\xd7:\xb4s\x83\x18\x98\x8c\xc9n\xd3', 
    __pyx_v_self=<optimized out>) at attic/hashindex.c:2161
#3  __pyx_pw_5attic_9hashindex_7NSIndex_1__getitem__ (__pyx_v_self=<attic.hashindex.NSIndex at remote 0x7f25d0d7ff18>, __pyx_v_key=
    b'\x1d>\xb7Y\xf9\x11\xd8\xde\xbc\xbft\nhz\xe8?A%\x8b\x8dM\xd7:\xb4s\x83\x18\x98\x8c\xc9n\xd3') at attic/hashindex.c:2110
#4  0x00000000004b6a90 in PyEval_EvalFrameEx (f=f@entry=
    Frame 0x22dbf70, for file /usr/local/lib/python3.2/dist-packages/Attic-0.10_73_g66a84c0-py3.2-linux-x86_64.egg/attic/repository.py, line 351, in put (self=<Repository(compact={44877, 44878}, _active_txn=True, index=<attic.hashindex.NSIndex at remote 0x7f25d0d7ff18>, max_segment_size=5242880, lock=<UpgradableLock(path='/path/to/repository/config', fd=<_io.TextIOWrapper at remote 0x7f25d2576cf8>, is_exclusive=True) at remote 0x7f25d0d64790>, segments_per_dir=10000, segments={1: 102, 2: 113, 3: 73, 4: 93, 5: 93, 6: 72, 7: 88, 8: 84, 9: 76, 10: 112, 11: 132, 12: 141, 13: 133, 14: 117, 15: 129, 16: 123, 17: 147, 18: 131, 19: 118, 20: 126, 21: 131, 22: 121, 23: 145, 24: 130, 25: 121, 26: 127, 27: 130, 28: 132, 29: 128, 30: 131, 31: 127, 32: 127, 33: 120, 34: 83, 35: 98, 36: 92, 37: 70, 38: 74, 39: 109, 40: 87, 41: 87, 42: 104, 43: 91, 44: 107, 45: 193, 46: 220, 47: 230, 48: 202, 49: 195, 50: 206, 51: 83, 52: 126, 53: 131, 54: 151, 55: 136, 56: 137, 57: 145, 58: 128, 59: 139, 60: 133, 6...(truncated), throwflag=throwflag@entry=0) at ../Python/ceval.c:1608
#5  0x00000000004cdee7 in PyEval_EvalCodeEx (_co=<optimized out>, globals=<optimized out>, locals=locals@entry=0x0, args=<optimized out>, argcount=<optimized out>, kws=kws@entry=0x0, 
    kwcount=kwcount@entry=0, defs=defs@entry=0x7f25d0d5c8a8, defcount=defcount@entry=1, kwdefs=0x0, closure=0x0) at ../Python/ceval.c:3350
#6  0x00000000004ce9b9 in function_call.62938 (func=<function at remote 0x7f25d0d5f518>, arg=<optimized out>, kw=<optimized out>) at ../Objects/funcobject.c:629
#7  0x00000000004a833b in PyObject_Call (func=func@entry=<function at remote 0x7f25d0d5f518>, arg=arg@entry=
    (<Repository(compact={44877, 44878}, _active_txn=True, index=<attic.hashindex.NSIndex at remote 0x7f25d0d7ff18>, max_segment_size=5242880, lock=<UpgradableLock(path='/path/to/repository/config', fd=<_io.TextIOWrapper at remote 0x7f25d2576cf8>, is_exclusive=True) at remote 0x7f25d0d64790>, segments_per_dir=10000, segments={1: 102, 2: 113, 3: 73, 4: 93, 5: 93, 6: 72, 7: 88, 8: 84, 9: 76, 10: 112, 11: 132, 12: 141, 13: 133, 14: 117, 15: 129, 16: 123, 17: 147, 18: 131, 19: 118, 20: 126, 21: 131, 22: 121, 23: 145, 24: 130, 25: 121, 26: 127, 27: 130, 28: 132, 29: 128, 30: 131, 31: 127, 32: 127, 33: 120, 34: 83, 35: 98, 36: 92, 37: 70, 38: 74, 39: 109, 40: 87, 41: 87, 42: 104, 43: 91, 44: 107, 45: 193, 46: 220, 47: 230, 48: 202, 49: 195, 50: 206, 51: 83, 52: 126, 53: 131, 54: 151, 55: 136, 56: 137, 57: 145, 58: 128, 59: 139, 60: 133, 61: 152, 62: 144, 63: 111, 64: 75, 65: 177, 66: 184, 67: 172, 68: 176, 69: 165, 70: 164, 71: 176, 72: 170, 73: 189, 74: 157, 75: 157, 76: 156, 77: 182, 78:...(truncated), kw=kw@entry=0x0) at ../Objects/abstract.c:2149
#8  0x00000000004b8d0d in ext_do_call (nk=-791305280, na=1, flags=<optimized out>, pp_stack=0x7fff20c69110, func=<function at remote 0x7f25d0d5f518>) at ../Python/ceval.c:4236
#9  PyEval_EvalFrameEx (f=<optimized out>, throwflag=throwflag@entry=0) at ../Python/ceval.c:2733
#10 0x00000000004ba36e in fast_function (nk=<optimized out>, na=1, n=<optimized out>, pp_stack=0x7fff20c692b0, func=<function at remote 0x7f25d0d661e8>) at ../Python/ceval.c:4009
#11 call_function (oparg=<optimized out>, pp_stack=0x7fff20c692b0) at ../Python/ceval.c:3942
#12 PyEval_EvalFrameEx (f=<optimized out>, throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
#13 0x00000000004ba36e in fast_function (nk=<optimized out>, na=1, n=<optimized out>, pp_stack=0x7fff20c69460, func=<function at remote 0x7f25d0d660d8>) at ../Python/ceval.c:4009
#14 call_function (oparg=<optimized out>, pp_stack=0x7fff20c69460) at ../Python/ceval.c:3942
#15 PyEval_EvalFrameEx (f=f@entry=
    Frame 0x1f9fa00, for file /usr/local/lib/python3.2/dist-packages/Attic-0.10_73_g66a84c0-py3.2-linux-x86_64.egg/attic/archiver.py, line 417, in run (self=<Archiver(exit_code=0) at remote 0x7f25d2dba490>, args=['serve'], keys_dir='/home/attic/.attic/keys', cache_dir='/home/attic/.cache/attic', common_parser=<ArgumentParser(_negative_number_matcher=<_sre.SRE_Pattern at remote 0x22c3b40>, _option_string_actions={'-v': <_StoreTrueAction(const=True, help='verbose output', option_strings=['-v', '--verbose'], dest='verbose', required=False, nargs=0, choices=None, default=False, container=<_ArgumentGroup(_mutually_exclusive_groups=[], _negative_number_matcher=<_sre.SRE_Pattern at remote 0x22c3b40>, description=None, _option_string_actions={...}, title='optional arguments', _has_negative_number_optionals=[], _defaults={}, prefix_chars='-', argument_default=None, _registries={'action': {'store_false': <type at remote 0x21b72d0>, 'append_const': <type at remote 0x21b7ff0>, 'help': <type at remote 0x21b8cd0>, None: <type ...(truncated), throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
#16 0x00000000004cdee7 in PyEval_EvalCodeEx (_co=<optimized out>, globals=<optimized out>, locals=locals@entry=0x0, args=<optimized out>, argcount=argcount@entry=2, kws=0x219c650, 
    kwcount=0, defs=0x7f25d0d5cae8, defcount=1, kwdefs=0x0, closure=0x0) at ../Python/ceval.c:3350
#17 0x00000000004ba764 in fast_function (nk=<optimized out>, na=2, n=<optimized out>, pp_stack=0x7fff20c696d0, func=<function at remote 0x7f25d0d69380>) at ../Python/ceval.c:4019
#18 call_function (oparg=<optimized out>, pp_stack=0x7fff20c696d0) at ../Python/ceval.c:3942
#19 PyEval_EvalFrameEx (f=<optimized out>, throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
#20 0x00000000004ba36e in fast_function (nk=<optimized out>, na=0, n=<optimized out>, pp_stack=0x7fff20c69880, func=<function at remote 0x7f25d0d60958>) at ../Python/ceval.c:4009
#21 call_function (oparg=<optimized out>, pp_stack=0x7fff20c69880) at ../Python/ceval.c:3942
#22 PyEval_EvalFrameEx (f=f@entry=
    Frame 0x2141e60, for file /usr/local/lib/python3.2/dist-packages/Attic-0.10_73_g66a84c0-py3.2-linux-x86_64.egg/EGG-INFO/scripts/attic, line 3, in <module> (), 
    throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
#23 0x00000000004cdee7 in PyEval_EvalCodeEx (_co=<optimized out>, globals=<optimized out>, locals=<optimized out>, args=args@entry=0x0, argcount=argcount@entry=0, kws=kws@entry=0x0, 
    kwcount=kwcount@entry=0, defs=defs@entry=0x0, defcount=defcount@entry=0, kwdefs=kwdefs@entry=0x0, closure=closure@entry=0x0) at ../Python/ceval.c:3350
#24 0x0000000000557e2d in PyEval_EvalCode (locals=<optimized out>, globals=<optimized out>, co=<optimized out>) at ../Python/ceval.c:767
#25 builtin_exec (self=<optimized out>, args=<optimized out>) at ../Python/bltinmodule.c:840
#26 0x00000000004b666f in call_function (oparg=<optimized out>, pp_stack=0x7fff20c69bb0) at ../Python/ceval.c:3921
#27 PyEval_EvalFrameEx (f=<optimized out>, throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
#28 0x00000000004ba36e in fast_function (nk=<optimized out>, na=3, n=<optimized out>, pp_stack=0x7fff20c69d60, func=<function at remote 0x7f25d2e15628>) at ../Python/ceval.c:4009
#29 call_function (oparg=<optimized out>, pp_stack=0x7fff20c69d60) at ../Python/ceval.c:3942
#30 PyEval_EvalFrameEx (f=<optimized out>, throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
#31 0x00000000004ba36e in fast_function (nk=<optimized out>, na=3, n=<optimized out>, pp_stack=0x7fff20c69f10, func=<function at remote 0x7f25d2deb6b0>) at ../Python/ceval.c:4009
#32 call_function (oparg=<optimized out>, pp_stack=0x7fff20c69f10) at ../Python/ceval.c:3942
#33 PyEval_EvalFrameEx (f=f@entry=Frame 0x206ac10, for file /usr/local/bin/attic, line 5, in <module> (), throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
#34 0x00000000004cdee7 in PyEval_EvalCodeEx (_co=_co@entry=<code at remote 0x7f25d2ebdbe0>, globals=globals@entry=
---Type <return> to continue, or q <return> to quit---
    {'__builtins__': {'bytearray': <type at remote 0x8c83e0>, 'IndexError': <type at remote 0x8bcda0>, 'all': <built-in method all of module object at remote 0x7f25d43247a0>, 'help': <_Helper at remote 0x7f25d2e8c190>, 'vars': <built-in method vars of module object at remote 0x7f25d43247a0>, 'SyntaxError': <type at remote 0x8bfb40>, 'UnicodeDecodeError': <type at remote 0x8beb00>, 'memoryview': <type at remote 0x8c7880>, 'isinstance': <built-in method isinstance of module object at remote 0x7f25d43247a0>, '__build_class__': <built-in method __build_class__ of module object at remote 0x7f25d43247a0>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2012 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCopyright (c) 1995-2001 Corporation for National Research Initiatives.\nAll Rights Reserved.\n\nCopyright (c) 1991-1995 Stichting Mathematisch Centrum, Amsterdam.\nAll Rights Reserved.', _Printer__lines=None, _Printer__name='copyright', _Printer__di...(truncated), locals=locals@entry=
    {'__builtins__': {'bytearray': <type at remote 0x8c83e0>, 'IndexError': <type at remote 0x8bcda0>, 'all': <built-in method all of module object at remote 0x7f25d43247a0>, 'help': <_Helper at remote 0x7f25d2e8c190>, 'vars': <built-in method vars of module object at remote 0x7f25d43247a0>, 'SyntaxError': <type at remote 0x8bfb40>, 'UnicodeDecodeError': <type at remote 0x8beb00>, 'memoryview': <type at remote 0x8c7880>, 'isinstance': <built-in method isinstance of module object at remote 0x7f25d43247a0>, '__build_class__': <built-in method __build_class__ of module object at remote 0x7f25d43247a0>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2012 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCopyright (c) 1995-2001 Corporation for National Research Initiatives.\nAll Rights Reserved.\n\nCopyright (c) 1991-1995 Stichting Mathematisch Centrum, Amsterdam.\nAll Rights Reserved.', _Printer__lines=None, _Printer__name='copyright', _Printer__di...(truncated), args=args@entry=0x0, argcount=argcount@entry=0, kws=kws@entry=0x0, kwcount=kwcount@entry=0, 
    defs=defs@entry=0x0, defcount=defcount@entry=0, kwdefs=kwdefs@entry=0x0, closure=closure@entry=0x0) at ../Python/ceval.c:3350
#35 0x00000000005464bf in PyEval_EvalCode (locals=
    {'__builtins__': {'bytearray': <type at remote 0x8c83e0>, 'IndexError': <type at remote 0x8bcda0>, 'all': <built-in method all of module object at remote 0x7f25d43247a0>, 'help': <_Helper at remote 0x7f25d2e8c190>, 'vars': <built-in method vars of module object at remote 0x7f25d43247a0>, 'SyntaxError': <type at remote 0x8bfb40>, 'UnicodeDecodeError': <type at remote 0x8beb00>, 'memoryview': <type at remote 0x8c7880>, 'isinstance': <built-in method isinstance of module object at remote 0x7f25d43247a0>, '__build_class__': <built-in method __build_class__ of module object at remote 0x7f25d43247a0>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2012 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCopyright (c) 1995-2001 Corporation for National Research Initiatives.\nAll Rights Reserved.\n\nCopyright (c) 1991-1995 Stichting Mathematisch Centrum, Amsterdam.\nAll Rights Reserved.', _Printer__lines=None, _Printer__name='copyright', _Printer__di...(truncated), globals=
    {'__builtins__': {'bytearray': <type at remote 0x8c83e0>, 'IndexError': <type at remote 0x8bcda0>, 'all': <built-in method all of module object at remote 0x7f25d43247a0>, 'help': <_Helper at remote 0x7f25d2e8c190>, 'vars': <built-in method vars of module object at remote 0x7f25d43247a0>, 'SyntaxError': <type at remote 0x8bfb40>, 'UnicodeDecodeError': <type at remote 0x8beb00>, 'memoryview': <type at remote 0x8c7880>, 'isinstance': <built-in method isinstance of module object at remote 0x7f25d43247a0>, '__build_class__': <built-in method __build_class__ of module object at remote 0x7f25d43247a0>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2012 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCopyright (c) 1995-2001 Corporation for National Research Initiatives.\nAll Rights Reserved.\n\nCopyright (c) 1991-1995 Stichting Mathematisch Centrum, Amsterdam.\nAll Rights Reserved.', _Printer__lines=None, _Printer__name='copyright', _Printer__di...(truncated), co=<code at remote 0x7f25d2ebdbe0>) at ../Python/ceval.c:767
#36 run_mod (mod=<optimized out>, filename=<optimized out>, globals=
    {'__builtins__': {'bytearray': <type at remote 0x8c83e0>, 'IndexError': <type at remote 0x8bcda0>, 'all': <built-in method all of module object at remote 0x7f25d43247a0>, 'help': <_Helper at remote 0x7f25d2e8c190>, 'vars': <built-in method vars of module object at remote 0x7f25d43247a0>, 'SyntaxError': <type at remote 0x8bfb40>, 'UnicodeDecodeError': <type at remote 0x8beb00>, 'memoryview': <type at remote 0x8c7880>, 'isinstance': <built-in method isinstance of module object at remote 0x7f25d43247a0>, '__build_class__': <built-in method __build_class__ of module object at remote 0x7f25d43247a0>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2012 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCopyright (c) 1995-2001 Corporation for National Research Initiatives.\nAll Rights Reserved.\n\nCopyright (c) 1991-1995 Stichting Mathematisch Centrum, Amsterdam.\nAll Rights Reserved.', _Printer__lines=None, _Printer__name='copyright', _Printer__di...(truncated), locals=
    {'__builtins__': {'bytearray': <type at remote 0x8c83e0>, 'IndexError': <type at remote 0x8bcda0>, 'all': <built-in method all of module object at remote 0x7f25d43247a0>, 'help': <_Helper at remote 0x7f25d2e8c190>, 'vars': <built-in method vars of module object at remote 0x7f25d43247a0>, 'SyntaxError': <type at remote 0x8bfb40>, 'UnicodeDecodeError': <type at remote 0x8beb00>, 'memoryview': <type at remote 0x8c7880>, 'isinstance': <built-in method isinstance of module object at remote 0x7f25d43247a0>, '__build_class__': <built-in method __build_class__ of module object at remote 0x7f25d43247a0>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2012 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCopyright (c) 1995-2001 Corporation for National Research Initiatives.\nAll Rights Reserved.\n\nCopyright (c) 1991-1995 Stichting Mathematisch Centrum, Amsterdam.\nAll Rights Reserved.', _Printer__lines=None, _Printer__name='copyright', _Printer__di...(truncated), flags=<optimized out>, arena=<optimized out>) at ../Python/pythonrun.c:1828
#37 0x000000000045420c in PyRun_FileExFlags (fp=fp@entry=0x2077b20, filename=filename@entry=0x7f25d2e89c20 "/usr/local/bin/attic", start=start@entry=257, globals=globals@entry=
    {'__builtins__': {'bytearray': <type at remote 0x8c83e0>, 'IndexError': <type at remote 0x8bcda0>, 'all': <built-in method all of module object at remote 0x7f25d43247a0>, 'help': <_Helper at remote 0x7f25d2e8c190>, 'vars': <built-in method vars of module object at remote 0x7f25d43247a0>, 'SyntaxError': <type at remote 0x8bfb40>, 'UnicodeDecodeError': <type at remote 0x8beb00>, 'memoryview': <type at remote 0x8c7880>, 'isinstance': <built-in method isinstance of module object at remote 0x7f25d43247a0>, '__build_class__': <built-in method __build_class__ of module object at remote 0x7f25d43247a0>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2012 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCopyright (c) 1995-2001 Corporation for National Research Initiatives.\nAll Rights Reserved.\n\nCopyright (c) 1991-1995 Stichting Mathematisch Centrum, Amsterdam.\nAll Rights Reserved.', _Printer__lines=None, _Printer__name='copyright', _Printer__di...(truncated), locals=locals@entry=
    {'__builtins__': {'bytearray': <type at remote 0x8c83e0>, 'IndexError': <type at remote 0x8bcda0>, 'all': <built-in method all of module object at remote 0x7f25d43247a0>, 'help': <_Helper at remote 0x7f25d2e8c190>, 'vars': <built-in method vars of module object at remote 0x7f25d43247a0>, 'SyntaxError': <type at remote 0x8bfb40>, 'UnicodeDecodeError': <type at remote 0x8beb00>, 'memoryview': <type at remote 0x8c7880>, 'isinstance': <built-in method isinstance of module object at remote 0x7f25d43247a0>, '__build_class__': <built-in method __build_class__ of module object at remote 0x7f25d43247a0>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2012 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCopyright (c) 1995-2001 Corporation for National Research Initiatives.\nAll Rights Reserved.\n\nCopyright (c) 1991-1995 Stichting Mathematisch Centrum, Amsterdam.\nAll Rights Reserved.', _Printer__lines=None, _Printer__name='copyright', _Printer__di...(truncated), closeit=closeit@entry=1, flags=flags@entry=0x7fff20c6a1d0) at ../Python/pythonrun.c:1785
#38 0x000000000045452c in PyRun_SimpleFileExFlags (fp=fp@entry=0x2077b20, filename=<optimized out>, closeit=closeit@entry=1, flags=flags@entry=0x7fff20c6a1d0) at ../Python/pythonrun.c:1299
#39 0x00000000004545f3 in PyRun_AnyFileExFlags (fp=fp@entry=0x2077b20, filename=<optimized out>, closeit=closeit@entry=1, flags=flags@entry=0x7fff20c6a1d0) at ../Python/pythonrun.c:1068
#40 0x00000000005587b5 in run_file (p_cf=0x7fff20c6a1d0, filename=0x1f002a0 L"/usr/local/bin/attic", fp=0x2077b20) at ../Modules/main.c:307
#41 Py_Main (argc=argc@entry=3, argv=argv@entry=0x1eff010) at ../Modules/main.c:733
#42 0x00000000004616eb in main (argc=3, argv=0x7fff20c6a3e8) at ../Modules/python.c:65

position 2:

(gdb) py-bt
Traceback (most recent call first):
  (frame information optimized out)
  File "/usr/local/lib/python3.2/dist-packages/Attic-0.10_73_g66a84c0-py3.2-linux-x86_64.egg/attic/repository.py", line 127, in commit
    self.compact_segments()
  (frame information optimized out)
  (frame information optimized out)
  File "/usr/local/lib/python3.2/dist-packages/Attic-0.10_73_g66a84c0-py3.2-linux-x86_64.egg/attic/archiver.py", line 417, in run
    return self.do_serve()
  (frame information optimized out)
  File "/usr/local/lib/python3.2/dist-packages/Attic-0.10_73_g66a84c0-py3.2-linux-x86_64.egg/EGG-INFO/scripts/attic", line 3, in <module>
    main()
  (frame information optimized out)
  (frame information optimized out)
  File "/usr/local/bin/attic", line 5, in <module>
    pkg_resources.run_script('Attic==0.10-73-g66a84c0', 'attic')

(gdb) bt
#0  0x00007f25d0d88f10 in hashindex_lookup (index=index@entry=0x22af9c0, key=0x7f25d0d68b48) at attic/_hashindex.c:89
#1  0x00007f25d0d88fb9 in hashindex_get (index=0x22af9c0, key=<optimized out>) at attic/_hashindex.c:315
#2  0x00007f25d0d8b2bb in __pyx_pf_5attic_9hashindex_7NSIndex___getitem__ (__pyx_v_key=b'\xe0(K\xb4S\xb6tsf\xf0<#\x96%B\xe8W\xc41\xb5]\xe7GA:\x174c\x15\x03\xdd\x03', 
    __pyx_v_self=<optimized out>) at attic/hashindex.c:2161
#3  __pyx_pw_5attic_9hashindex_7NSIndex_1__getitem__ (__pyx_v_self=<attic.hashindex.NSIndex at remote 0x7f25d0d6fd98>, __pyx_v_key=
    b'\xe0(K\xb4S\xb6tsf\xf0<#\x96%B\xe8W\xc41\xb5]\xe7GA:\x174c\x15\x03\xdd\x03') at attic/hashindex.c:2110
#4  0x00007f25d0d8a19f in __pyx_pf_5attic_9hashindex_9IndexBase_14get (__pyx_v_default=(-1, -1), __pyx_v_key=<optimized out>, __pyx_v_self=0x7f25d0d6fd98) at attic/hashindex.c:1725
#5  __pyx_pw_5attic_9hashindex_9IndexBase_15get (__pyx_v_self=<attic.hashindex.NSIndex at remote 0x7f25d0d6fd98>, __pyx_args=<optimized out>, __pyx_kwds=<optimized out>)
    at attic/hashindex.c:1683
#6  0x00000000004b666f in call_function (oparg=<optimized out>, pp_stack=0x7fff20c68c30) at ../Python/ceval.c:3921
#7  PyEval_EvalFrameEx (f=<optimized out>, throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
#8  0x00000000004ba36e in fast_function (nk=<optimized out>, na=1, n=<optimized out>, pp_stack=0x7fff20c68de0, func=<function at remote 0x7f25d0d5f0d8>) at ../Python/ceval.c:4009
#9  call_function (oparg=<optimized out>, pp_stack=0x7fff20c68de0) at ../Python/ceval.c:3942
#10 PyEval_EvalFrameEx (f=f@entry=
    Frame 0x22dee10, for file /usr/local/lib/python3.2/dist-packages/Attic-0.10_73_g66a84c0-py3.2-linux-x86_64.egg/attic/repository.py, line 127, in commit (self=<Repository(compact={44866, 44867}, _active_txn=True, index=<attic.hashindex.NSIndex at remote 0x7f25d0d6fd98>, max_segment_size=5242880, lock=<UpgradableLock(path='/path/to/repository/config', fd=<_io.TextIOWrapper at remote 0x7f25d2576cf8>, is_exclusive=True) at remote 0x7f25d0d64790>, segments_per_dir=10000, segments={1: 102, 2: 113, 3: 73, 4: 93, 5: 93, 6: 72, 7: 88, 8: 84, 9: 76, 10: 112, 11: 132, 12: 141, 13: 133, 14: 117, 15: 129, 16: 123, 17: 147, 18: 131, 19: 118, 20: 126, 21: 131, 22: 121, 23: 145, 24: 130, 25: 121, 26: 127, 27: 130, 28: 132, 29: 128, 30: 131, 31: 127, 32: 127, 33: 120, 34: 83, 35: 98, 36: 92, 37: 70, 38: 74, 39: 109, 40: 87, 41: 87, 42: 104, 43: 91, 44: 107, 45: 193, 46: 220, 47: 230, 48: 202, 49: 195, 50: 206, 51: 83, 52: 126, 53: 131, 54: 151, 55: 136, 56: 137, 57: 145, 58: 128, 59: 139, 60: 133...(truncated), throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
#11 0x00000000004cdee7 in PyEval_EvalCodeEx (_co=<optimized out>, globals=<optimized out>, locals=locals@entry=0x0, args=<optimized out>, argcount=<optimized out>, kws=kws@entry=0x0, 
    kwcount=kwcount@entry=0, defs=defs@entry=0x0, defcount=defcount@entry=0, kwdefs=0x0, closure=0x0) at ../Python/ceval.c:3350
#12 0x00000000004ce9b9 in function_call.62938 (func=<function at remote 0x7f25d0d549e0>, arg=<optimized out>, kw=<optimized out>) at ../Objects/funcobject.c:629
#13 0x00000000004a833b in PyObject_Call (func=func@entry=<function at remote 0x7f25d0d549e0>, arg=arg@entry=
    (<Repository(compact={44866, 44867}, _active_txn=True, index=<attic.hashindex.NSIndex at remote 0x7f25d0d6fd98>, max_segment_size=5242880, lock=<UpgradableLock(path='/path/to/repository/config', fd=<_io.TextIOWrapper at remote 0x7f25d2576cf8>, is_exclusive=True) at remote 0x7f25d0d64790>, segments_per_dir=10000, segments={1: 102, 2: 113, 3: 73, 4: 93, 5: 93, 6: 72, 7: 88, 8: 84, 9: 76, 10: 112, 11: 132, 12: 141, 13: 133, 14: 117, 15: 129, 16: 123, 17: 147, 18: 131, 19: 118, 20: 126, 21: 131, 22: 121, 23: 145, 24: 130, 25: 121, 26: 127, 27: 130, 28: 132, 29: 128, 30: 131, 31: 127, 32: 127, 33: 120, 34: 83, 35: 98, 36: 92, 37: 70, 38: 74, 39: 109, 40: 87, 41: 87, 42: 104, 43: 91, 44: 107, 45: 193, 46: 220, 47: 230, 48: 202, 49: 195, 50: 206, 51: 83, 52: 126, 53: 131, 54: 151, 55: 136, 56: 137, 57: 145, 58: 128, 59: 139, 60: 133, 61: 152, 62: 144, 63: 111, 64: 75, 65: 177, 66: 184, 67: 172, 68: 176, 69: 165, 70: 164, 71: 176, 72: 170, 73: 189, 74: 157, 75: 157, 76: 156, 77: 182, 78:...(truncated), kw=kw@entry=0x0) at ../Objects/abstract.c:2149
#14 0x00000000004b8d0d in ext_do_call (nk=-757388464, na=1, flags=<optimized out>, pp_stack=0x7fff20c69110, func=<function at remote 0x7f25d0d549e0>) at ../Python/ceval.c:4236
#15 PyEval_EvalFrameEx (f=<optimized out>, throwflag=throwflag@entry=0) at ../Python/ceval.c:2733
#16 0x00000000004ba36e in fast_function (nk=<optimized out>, na=1, n=<optimized out>, pp_stack=0x7fff20c692b0, func=<function at remote 0x7f25d0d661e8>) at ../Python/ceval.c:4009
#17 call_function (oparg=<optimized out>, pp_stack=0x7fff20c692b0) at ../Python/ceval.c:3942
#18 PyEval_EvalFrameEx (f=<optimized out>, throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
#19 0x00000000004ba36e in fast_function (nk=<optimized out>, na=1, n=<optimized out>, pp_stack=0x7fff20c69460, func=<function at remote 0x7f25d0d660d8>) at ../Python/ceval.c:4009
#20 call_function (oparg=<optimized out>, pp_stack=0x7fff20c69460) at ../Python/ceval.c:3942
#21 PyEval_EvalFrameEx (f=f@entry=
    Frame 0x1f9fa00, for file /usr/local/lib/python3.2/dist-packages/Attic-0.10_73_g66a84c0-py3.2-linux-x86_64.egg/attic/archiver.py, line 417, in run (self=<Archiver(exit_code=0) at remote 0x7f25d2dba490>, args=['serve'], keys_dir='/home/attic/.attic/keys', cache_dir='/home/attic/.cache/attic', common_parser=<ArgumentParser(_negative_number_matcher=<_sre.SRE_Pattern at remote 0x22c3b40>, _option_string_actions={'-v': <_StoreTrueAction(const=True, help='verbose output', option_strings=['-v', '--verbose'], dest='verbose', required=False, nargs=0, choices=None, default=False, container=<_ArgumentGroup(_mutually_exclusive_groups=[], _negative_number_matcher=<_sre.SRE_Pattern at remote 0x22c3b40>, description=None, _option_string_actions={...}, title='optional arguments', _has_negative_number_optionals=[], _defaults={}, prefix_chars='-', argument_default=None, _registries={'action': {'store_false': <type at remote 0x21b72d0>, 'append_const': <type at remote 0x21b7ff0>, 'help': <type at remote 0x21b8cd0>, None: <type ...(truncated), throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
#22 0x00000000004cdee7 in PyEval_EvalCodeEx (_co=<optimized out>, globals=<optimized out>, locals=locals@entry=0x0, args=<optimized out>, argcount=argcount@entry=2, kws=0x219c650, 
    kwcount=0, defs=0x7f25d0d5cae8, defcount=1, kwdefs=0x0, closure=0x0) at ../Python/ceval.c:3350
#23 0x00000000004ba764 in fast_function (nk=<optimized out>, na=2, n=<optimized out>, pp_stack=0x7fff20c696d0, func=<function at remote 0x7f25d0d69380>) at ../Python/ceval.c:4019
#24 call_function (oparg=<optimized out>, pp_stack=0x7fff20c696d0) at ../Python/ceval.c:3942
#25 PyEval_EvalFrameEx (f=<optimized out>, throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
#26 0x00000000004ba36e in fast_function (nk=<optimized out>, na=0, n=<optimized out>, pp_stack=0x7fff20c69880, func=<function at remote 0x7f25d0d60958>) at ../Python/ceval.c:4009
#27 call_function (oparg=<optimized out>, pp_stack=0x7fff20c69880) at ../Python/ceval.c:3942
#28 PyEval_EvalFrameEx (f=f@entry=
    Frame 0x2141e60, for file /usr/local/lib/python3.2/dist-packages/Attic-0.10_73_g66a84c0-py3.2-linux-x86_64.egg/EGG-INFO/scripts/attic, line 3, in <module> (), 
    throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
#29 0x00000000004cdee7 in PyEval_EvalCodeEx (_co=<optimized out>, globals=<optimized out>, locals=<optimized out>, args=args@entry=0x0, argcount=argcount@entry=0, kws=kws@entry=0x0, 
    kwcount=kwcount@entry=0, defs=defs@entry=0x0, defcount=defcount@entry=0, kwdefs=kwdefs@entry=0x0, closure=closure@entry=0x0) at ../Python/ceval.c:3350
#30 0x0000000000557e2d in PyEval_EvalCode (locals=<optimized out>, globals=<optimized out>, co=<optimized out>) at ../Python/ceval.c:767
#31 builtin_exec (self=<optimized out>, args=<optimized out>) at ../Python/bltinmodule.c:840
#32 0x00000000004b666f in call_function (oparg=<optimized out>, pp_stack=0x7fff20c69bb0) at ../Python/ceval.c:3921
#33 PyEval_EvalFrameEx (f=<optimized out>, throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
---Type <return> to continue, or q <return> to quit---
#34 0x00000000004ba36e in fast_function (nk=<optimized out>, na=3, n=<optimized out>, pp_stack=0x7fff20c69d60, func=<function at remote 0x7f25d2e15628>) at ../Python/ceval.c:4009
#35 call_function (oparg=<optimized out>, pp_stack=0x7fff20c69d60) at ../Python/ceval.c:3942
#36 PyEval_EvalFrameEx (f=<optimized out>, throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
#37 0x00000000004ba36e in fast_function (nk=<optimized out>, na=3, n=<optimized out>, pp_stack=0x7fff20c69f10, func=<function at remote 0x7f25d2deb6b0>) at ../Python/ceval.c:4009
#38 call_function (oparg=<optimized out>, pp_stack=0x7fff20c69f10) at ../Python/ceval.c:3942
#39 PyEval_EvalFrameEx (f=f@entry=Frame 0x206ac10, for file /usr/local/bin/attic, line 5, in <module> (), throwflag=throwflag@entry=0) at ../Python/ceval.c:2692
#40 0x00000000004cdee7 in PyEval_EvalCodeEx (_co=_co@entry=<code at remote 0x7f25d2ebdbe0>, globals=globals@entry=
    {'__builtins__': {'bytearray': <type at remote 0x8c83e0>, 'IndexError': <type at remote 0x8bcda0>, 'all': <built-in method all of module object at remote 0x7f25d43247a0>, 'help': <_Helper at remote 0x7f25d2e8c190>, 'vars': <built-in method vars of module object at remote 0x7f25d43247a0>, 'SyntaxError': <type at remote 0x8bfb40>, 'UnicodeDecodeError': <type at remote 0x8beb00>, 'memoryview': <type at remote 0x8c7880>, 'isinstance': <built-in method isinstance of module object at remote 0x7f25d43247a0>, '__build_class__': <built-in method __build_class__ of module object at remote 0x7f25d43247a0>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2012 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCopyright (c) 1995-2001 Corporation for National Research Initiatives.\nAll Rights Reserved.\n\nCopyright (c) 1991-1995 Stichting Mathematisch Centrum, Amsterdam.\nAll Rights Reserved.', _Printer__lines=None, _Printer__name='copyright', _Printer__di...(truncated), locals=locals@entry=
    {'__builtins__': {'bytearray': <type at remote 0x8c83e0>, 'IndexError': <type at remote 0x8bcda0>, 'all': <built-in method all of module object at remote 0x7f25d43247a0>, 'help': <_Helper at remote 0x7f25d2e8c190>, 'vars': <built-in method vars of module object at remote 0x7f25d43247a0>, 'SyntaxError': <type at remote 0x8bfb40>, 'UnicodeDecodeError': <type at remote 0x8beb00>, 'memoryview': <type at remote 0x8c7880>, 'isinstance': <built-in method isinstance of module object at remote 0x7f25d43247a0>, '__build_class__': <built-in method __build_class__ of module object at remote 0x7f25d43247a0>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2012 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCopyright (c) 1995-2001 Corporation for National Research Initiatives.\nAll Rights Reserved.\n\nCopyright (c) 1991-1995 Stichting Mathematisch Centrum, Amsterdam.\nAll Rights Reserved.', _Printer__lines=None, _Printer__name='copyright', _Printer__di...(truncated), args=args@entry=0x0, argcount=argcount@entry=0, kws=kws@entry=0x0, kwcount=kwcount@entry=0, 
    defs=defs@entry=0x0, defcount=defcount@entry=0, kwdefs=kwdefs@entry=0x0, closure=closure@entry=0x0) at ../Python/ceval.c:3350
#41 0x00000000005464bf in PyEval_EvalCode (locals=
    {'__builtins__': {'bytearray': <type at remote 0x8c83e0>, 'IndexError': <type at remote 0x8bcda0>, 'all': <built-in method all of module object at remote 0x7f25d43247a0>, 'help': <_Helper at remote 0x7f25d2e8c190>, 'vars': <built-in method vars of module object at remote 0x7f25d43247a0>, 'SyntaxError': <type at remote 0x8bfb40>, 'UnicodeDecodeError': <type at remote 0x8beb00>, 'memoryview': <type at remote 0x8c7880>, 'isinstance': <built-in method isinstance of module object at remote 0x7f25d43247a0>, '__build_class__': <built-in method __build_class__ of module object at remote 0x7f25d43247a0>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2012 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCopyright (c) 1995-2001 Corporation for National Research Initiatives.\nAll Rights Reserved.\n\nCopyright (c) 1991-1995 Stichting Mathematisch Centrum, Amsterdam.\nAll Rights Reserved.', _Printer__lines=None, _Printer__name='copyright', _Printer__di...(truncated), globals=
    {'__builtins__': {'bytearray': <type at remote 0x8c83e0>, 'IndexError': <type at remote 0x8bcda0>, 'all': <built-in method all of module object at remote 0x7f25d43247a0>, 'help': <_Helper at remote 0x7f25d2e8c190>, 'vars': <built-in method vars of module object at remote 0x7f25d43247a0>, 'SyntaxError': <type at remote 0x8bfb40>, 'UnicodeDecodeError': <type at remote 0x8beb00>, 'memoryview': <type at remote 0x8c7880>, 'isinstance': <built-in method isinstance of module object at remote 0x7f25d43247a0>, '__build_class__': <built-in method __build_class__ of module object at remote 0x7f25d43247a0>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2012 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCopyright (c) 1995-2001 Corporation for National Research Initiatives.\nAll Rights Reserved.\n\nCopyright (c) 1991-1995 Stichting Mathematisch Centrum, Amsterdam.\nAll Rights Reserved.', _Printer__lines=None, _Printer__name='copyright', _Printer__di...(truncated), co=<code at remote 0x7f25d2ebdbe0>) at ../Python/ceval.c:767
#42 run_mod (mod=<optimized out>, filename=<optimized out>, globals=
    {'__builtins__': {'bytearray': <type at remote 0x8c83e0>, 'IndexError': <type at remote 0x8bcda0>, 'all': <built-in method all of module object at remote 0x7f25d43247a0>, 'help': <_Helper at remote 0x7f25d2e8c190>, 'vars': <built-in method vars of module object at remote 0x7f25d43247a0>, 'SyntaxError': <type at remote 0x8bfb40>, 'UnicodeDecodeError': <type at remote 0x8beb00>, 'memoryview': <type at remote 0x8c7880>, 'isinstance': <built-in method isinstance of module object at remote 0x7f25d43247a0>, '__build_class__': <built-in method __build_class__ of module object at remote 0x7f25d43247a0>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2012 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCopyright (c) 1995-2001 Corporation for National Research Initiatives.\nAll Rights Reserved.\n\nCopyright (c) 1991-1995 Stichting Mathematisch Centrum, Amsterdam.\nAll Rights Reserved.', _Printer__lines=None, _Printer__name='copyright', _Printer__di...(truncated), locals=
    {'__builtins__': {'bytearray': <type at remote 0x8c83e0>, 'IndexError': <type at remote 0x8bcda0>, 'all': <built-in method all of module object at remote 0x7f25d43247a0>, 'help': <_Helper at remote 0x7f25d2e8c190>, 'vars': <built-in method vars of module object at remote 0x7f25d43247a0>, 'SyntaxError': <type at remote 0x8bfb40>, 'UnicodeDecodeError': <type at remote 0x8beb00>, 'memoryview': <type at remote 0x8c7880>, 'isinstance': <built-in method isinstance of module object at remote 0x7f25d43247a0>, '__build_class__': <built-in method __build_class__ of module object at remote 0x7f25d43247a0>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2012 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCopyright (c) 1995-2001 Corporation for National Research Initiatives.\nAll Rights Reserved.\n\nCopyright (c) 1991-1995 Stichting Mathematisch Centrum, Amsterdam.\nAll Rights Reserved.', _Printer__lines=None, _Printer__name='copyright', _Printer__di...(truncated), flags=<optimized out>, arena=<optimized out>) at ../Python/pythonrun.c:1828
#43 0x000000000045420c in PyRun_FileExFlags (fp=fp@entry=0x2077b20, filename=filename@entry=0x7f25d2e89c20 "/usr/local/bin/attic", start=start@entry=257, globals=globals@entry=
    {'__builtins__': {'bytearray': <type at remote 0x8c83e0>, 'IndexError': <type at remote 0x8bcda0>, 'all': <built-in method all of module object at remote 0x7f25d43247a0>, 'help': <_Helper at remote 0x7f25d2e8c190>, 'vars': <built-in method vars of module object at remote 0x7f25d43247a0>, 'SyntaxError': <type at remote 0x8bfb40>, 'UnicodeDecodeError': <type at remote 0x8beb00>, 'memoryview': <type at remote 0x8c7880>, 'isinstance': <built-in method isinstance of module object at remote 0x7f25d43247a0>, '__build_class__': <built-in method __build_class__ of module object at remote 0x7f25d43247a0>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2012 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCopyright (c) 1995-2001 Corporation for National Research Initiatives.\nAll Rights Reserved.\n\nCopyright (c) 1991-1995 Stichting Mathematisch Centrum, Amsterdam.\nAll Rights Reserved.', _Printer__lines=None, _Printer__name='copyright', _Printer__di...(truncated), locals=locals@entry=
    {'__builtins__': {'bytearray': <type at remote 0x8c83e0>, 'IndexError': <type at remote 0x8bcda0>, 'all': <built-in method all of module object at remote 0x7f25d43247a0>, 'help': <_Helper at remote 0x7f25d2e8c190>, 'vars': <built-in method vars of module object at remote 0x7f25d43247a0>, 'SyntaxError': <type at remote 0x8bfb40>, 'UnicodeDecodeError': <type at remote 0x8beb00>, 'memoryview': <type at remote 0x8c7880>, 'isinstance': <built-in method isinstance of module object at remote 0x7f25d43247a0>, '__build_class__': <built-in method __build_class__ of module object at remote 0x7f25d43247a0>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2012 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCopyright (c) 1995-2001 Corporation for National Research Initiatives.\nAll Rights Reserved.\n\nCopyright (c) 1991-1995 Stichting Mathematisch Centrum, Amsterdam.\nAll Rights Reserved.', _Printer__lines=None, _Printer__name='copyright', _Printer__di...(truncated), closeit=closeit@entry=1, flags=flags@entry=0x7fff20c6a1d0) at ../Python/pythonrun.c:1785
#44 0x000000000045452c in PyRun_SimpleFileExFlags (fp=fp@entry=0x2077b20, filename=<optimized out>, closeit=closeit@entry=1, flags=flags@entry=0x7fff20c6a1d0) at ../Python/pythonrun.c:1299
---Type <return> to continue, or q <return> to quit---
#45 0x00000000004545f3 in PyRun_AnyFileExFlags (fp=fp@entry=0x2077b20, filename=<optimized out>, closeit=closeit@entry=1, flags=flags@entry=0x7fff20c6a1d0) at ../Python/pythonrun.c:1068
#46 0x00000000005587b5 in run_file (p_cf=0x7fff20c6a1d0, filename=0x1f002a0 L"/usr/local/bin/attic", fp=0x2077b20) at ../Modules/main.c:307
#47 Py_Main (argc=argc@entry=3, argv=argv@entry=0x1eff010) at ../Modules/main.c:733
#48 0x00000000004616eb in main (argc=3, argv=0x7fff20c6a3e8) at ../Modules/python.c:65

I have also made another experiment. I measured the time it took to transfer a 2,2MB jpg file (the time between two successive lines in the verbose output. It took ~4 minutes. Then, while attic was still doing its job, I run on data source host: scp /path/to/file.jpg attic@repohost.example.org:/path/to/repository/. It took a couple or two of seconds...

The remote machine is not swapping or low in RAM.

I am thinking to try with a remote filesystem other than NFS: smb/cifs or something else, but maybe there are issues with locking or other semantics.

[jborg]

Are all files equally slow or just some?

This traceback suggest that hashindex is slow. Hashindex is a persistent dict/hashtable that is written in C and uses mmap(). This thing is normally extremely fast since mmap() is used and all relevant data usually ends up in the kernel buffer cache. Perhaps this does not work well with NFS in general or at least your client.

[Ernest0x]

Are all files equally slow or just some?

Not all files seem to be equally slow, but I am not sure if the quick ones are in the category of the unchanged (so not transferred) or not. To have a better view on this, however, it would be really handy if there were timestamps at log lines. I have just opened a related issue for this.