help with tail_build

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hi

My (linux) build actually works but I face a stressing situation

Each time I do a git pull -r and then make, then tail_build seems to
build from scratch and takes hours to finish, making my work a PITA.

my autogen is this one:
- --with-num-cpus=4
- --with-max-jobs=4
- --with-vendor=Olivier Hallot
- --enable-graphite
- --with-lang=pt-BR en-US qtz
- --disable-mozilla

I have a I5 machine with 6GB.

I must be missing something... I'll appreciate some advise to make
tail_build compile faster/shorter

Regards
- --
Olivier Hallot
Founder, Board of Directors Member - The Document Foundation
The Document Foundation, Zimmerstr. 69, 10117 Berlin, Germany
Fundação responsável civilmente, de acordo com o direito civil
Detalhes Legais: http://www.documentfoundation.org/imprint
LibreOffice translation leader for Brazilian Portuguese
+55-21-8822-8812

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.11 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iQEcBAEBAgAGBQJP9Cb+AAoJEJp3R7nH3vLxi3IH/0M8rqKzlWqSBq4l98+2DZsu
JVQ7Gz9ZSzT4IruHcrida8kx2MAFJzPO3+jcHch4rfRvwPpNn+1IZiaG4qqWCFQN
F4z49qdyJUc5xYTNoLjCF7zMAnd9r9jydlgM8/h5rXydHa6MqlKSiAREElir1CsP
V5dvqmiZfUZD06G/XcMIJ1qn7tnW7gdI2muGKDYttu//U1pPbDDWCMQ22BS3a/wA
rcDcjxrDSMtnxJ2GvvYfAnCjk/qyChjj997mPPqptdhEy/UnmdCSu5r99gkrUI+d
8k4A3q2uW731/TpYCk2f1O6MQgtSS+ErvO6Ilx+upb2UR5/giIlJvDPHnMYukmw=
=SJFx
-----END PGP SIGNATURE-----
_______________________________________________
LibreOffice mailing list
[hidden email]
http://lists.freedesktop.org/mailman/listinfo/libreoffice

I think this is mostly because Michael Meeks is working his way through
relicensing the code, which means he is touching stuff near the bottom
of the dependency graph, which means everything gets rebuilt.

I've gotten into  the habit of doing a pull  and then a rebuild at the
end of my working day so that it gets a chance to rebuild overnight.

On 2012-07-04 13:20, Olivier Hallot wrote:


Disclaimer: http://www.peralex.com/disclaimer.html


_______________________________________________
LibreOffice mailing list
[hidden email]
http://lists.freedesktop.org/mailman/listinfo/libreoffice

On Wed, 2012-07-04 at 08:20 -0300, Olivier Hallot wrote:
> Each time I do a git pull -r and then make, then tail_build seems to
> build from scratch and takes hours to finish, making my work a PITA.

        Noel points out that my re-basing work has quite some ripple-through; I
try to chunk my work together and push relatively infrequently, but ...
there is a certain amount of this that is inevitable for the next weeks.

> I must be missing something... I'll appreciate some advise to make
> tail_build compile faster/shorter

        So - on master 'tail_build' is ~almost all of LibreOffice, with
correct[1] dependencies; so it doesn't really get much better than this.
If someone changes a low-level header you can expect a big re-compile
cascade sadly.

        What I suggest you do is to have a 'push tree', so you work on one
tree, and test your patches there - and commit them there, and do:

        git format-patch -1
        (cd ../push_tree ; git am) < 0001-foo-baa.patch

        And then git pull -r ; git push in the 'push tree' - which is just a
simple git checkout with no build next to it.

        That then avoids the need to do a full re-build in your current tree
(it also makes it cheaper to swap branch and cherry-pick across branches
etc.).

        HTH,

                Michael.

[1] - hopefully correct anyhow ;-)
--
[hidden email]  <><, Pseudo Engineer, itinerant idiot

_______________________________________________
LibreOffice mailing list
[hidden email]
http://lists.freedesktop.org/mailman/listinfo/libreoffice

Hi,

On Wednesday, 2012-07-04 13:10:10 +0100, Michael Meeks wrote:

> git format-patch -1
> (cd ../push_tree ; git am) < 0001-foo-baa.patch

Just as a side note, this can be done in one command without leaving
intermediate files around:

git format-patch --stdout -1 | (cd ../push_tree ; git am)

Or, if the push_tree is the current working directory:

(cd ../working_tree ; git format-patch --stdout -1) | git am


  Eike

--
LibreOffice Calc developer. Number formatter stricken i18n transpositionizer.
GnuPG key 0x293C05FD : 997A 4C60 CE41 0149 0DB3  9E96 2F1A D073 293C 05FD

_______________________________________________
LibreOffice mailing list
[hidden email]
http://lists.freedesktop.org/mailman/listinfo/libreoffice

On 04.07.2012 13:20, Olivier Hallot wrote: Note you don't need --disable-mozilla any more. It is disabled be
default (on master).

Can you check the place in autogen.sh output if ccache was correctly
detected?
It sounds like you are compiling without ccache.
Try ccache -s to check if it is working correctly (in my case):
[...]
cache hit (direct)                 98667
[...]
cache size                            23.0 Gbytes
max cache size                    100.0 Gbytes

Also it may be needed to configure ccache, add something like this in
~/.bashrc:

# optionaly set CCACHE_DIR to second hard drive if you have one:
export CCACHE_DIR=/mnt/your_second_hard_drive
# set max cache size to 100 GB
ccache -M 100

Regards
David

_______________________________________________
LibreOffice mailing list
[hidden email]
http://lists.freedesktop.org/mailman/listinfo/libreoffice

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Thanks gentlemen for the advise. Indeed must be the rebasing that
affects files.

About ccache, I have this

tdf@olivier-Vostro-3500:~/git/core$ ccache -s
cache directory                     /home/tdf/.ccache
cache hit (direct)                 38119
cache hit (preprocessed)            2777
cache miss                        555377
called for link                    34522
called for preprocessing           17873
multiple source files                 42
compile failed                     16381
preprocessor error                   929
bad compiler arguments              1397
unsupported source language          132
autoconf compile/link              16801
unsupported compiler option        45503
no input file                     141897
files in cache                      9547
cache size                         924.3 Mbytes
max cache size                       1.0 Gbytes

Given I don't have a second drive, what figures should I improve here?
(Notebook with i5 and 6 GB RAM)

Thanks

Olivier


Em 04-07-2012 16:50, David Ostrovsky escreveu:
- --
Olivier Hallot
Founder, Board of Directors Member - The Document Foundation
The Document Foundation, Zimmerstr. 69, 10117 Berlin, Germany
Fundação responsável civilmente, de acordo com o direito civil
Detalhes Legais: http://www.documentfoundation.org/imprint
LibreOffice translation leader for Brazilian Portuguese
+55-21-8822-8812


-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.11 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iQEcBAEBAgAGBQJP9OfdAAoJEJp3R7nH3vLxlc8H/04I/3l0YbUYrJVxEbsnoger
pe5o3rdoiRzQGOv7cu+uTapho+UTH26nXyElEq/T14VP/VkEh0d3Hcvy4uGI3U2p
LNnvQg67l8NtEyB7q4JJ7PEe+0ID5nnEzyWDm3zbkutLTtfdapQLHFw6Tev0PbNb
azm1dyChTmjYgM3/0tVPDaawP9en/6Nuqb3YOhlzbRxXOlHDSUR/JcBlFqSqydxo
5LBnxUl2ioYXyDv+CqOrhwUeYl87AfntnFoNqfMpAuGQ9SnGcmglWL5KGaHGVV7t
L+5gBfzBj7X+Ll0HRzFxQGW4nVnaNfBc14fhjZwtEMzJrGnsvIY2uVn2JUuH13o=
=AIB0
-----END PGP SIGNATURE-----
_______________________________________________
LibreOffice mailing list
[hidden email]
http://lists.freedesktop.org/mailman/listinfo/libreoffice

On 2012-07-05 03:03, Olivier Hallot wrote:
> Given I don't have a second drive, what figures should I improve here?
> (Notebook with i5 and 6 GB RAM)
>
>
By yourself an SSD drive - laptop hard drives are generally very slow
beasts, typical 5400rpm drives.
Seriously, it will completely transform your experience :-)
I'm using an OCZ Vertex and I'm a very happy user.

Disclaimer: http://www.peralex.com/disclaimer.html


_______________________________________________
LibreOffice mailing list
[hidden email]
http://lists.freedesktop.org/mailman/listinfo/libreoffice

On Wed, Jul 04, 2012 at 10:03:25PM -0300, Olivier Hallot wrote:

> About ccache, I have this

> tdf@olivier-Vostro-3500:~/git/core$ ccache -s
> cache directory                     /home/tdf/.ccache
> cache hit (direct)                 38119
> cache hit (preprocessed)            2777
> cache miss                        555377
> cache size                         924.3 Mbytes
> max cache size                       1.0 Gbytes

The max cache size if far too low to be useful for LibreOffice
development, especially if you do a debug / symbols build. The cache
needs to be at least big enough to hold all  LibreOffice .o files, and
then some (to support switching between branches).

If you are low on disks space, enable compression.

--
Lionel
_______________________________________________
LibreOffice mailing list
[hidden email]
http://lists.freedesktop.org/mailman/listinfo/libreoffice

On 05/07/12 10:43, Lionel Elie Mamane wrote:
the documentation on this was a bit short on details, so i've added some
more here:

https://wiki.documentfoundation.org/Development/Native_Build#ccache


_______________________________________________
LibreOffice mailing list
[hidden email]
http://lists.freedesktop.org/mailman/listinfo/libreoffice