Hi
I am experiencing some problems with the GetComponents script. It does not seem to be doing anything and invoking --debug and --verbose does not produce any output at all either.
I have tried to change the first line to the output of *whereis perl*: !/usr/bin/perl but that didn't change anything.
Here's some info on my settings: I'm using* Ubuntu 22.04* *git version 2.33.1* *svn, version 1.14.1 (r1886195)*, compiled Dec 3 2021, 20:03:34 on x86_64-pc-linux-gnu
Summary of my perl5 (revision 5 version 32 subversion 1) configuration:
Platform: osname=linux osvers=4.19.0 archname=x86_64-linux-gnu-thread-multi uname='linux localhost 4.19.0 #1 smp debian 4.19.0 x86_64 gnulinux ' config_args='-Dmksymlinks -Dusethreads -Duselargefiles -Dcc=x86_64-linux-gnu-gcc -Dcpp=x86_64-linux-gnu-cpp -Dld=x86_64-linux-gnu-gcc -Dccflags=-DDEBIAN -Wdate-time -D_FORTIFY_SOURCE=2 -g -O2 -ffile-prefix-map=/dummy/build/dir=. -flto=auto -ffat-lto-objects -fstack-protector-strong -Wformat -Werror=format-security -Dldflags= -Wl,-Bsymbolic-functions -flto=auto -Wl,-z,relro -Dlddlflags=-shared -Wl,-Bsymbolic-functions -flto=auto -Wl,-z,relro -Dcccdlflags=-fPIC -Darchname=x86_64-linux-gnu -Dprefix=/usr -Dprivlib=/usr/share/perl/5.32 -Darchlib=/usr/lib/x86_64-linux-gnu/perl/5.32 -Dvendorprefix=/usr -Dvendorlib=/usr/share/perl5 -Dvendorarch=/usr/lib/x86_64-linux-gnu/perl5/5.32 -Dsiteprefix=/usr/local -Dsitelib=/usr/local/share/perl/5.32.1 -Dsitearch=/usr/local/lib/x86_64-linux-gnu/perl/5.32.1 -Dman1dir=/usr/share/man/man1 -Dman3dir=/usr/share/man/man3 -Dsiteman1dir=/usr/local/man/man1 -Dsiteman3dir=/usr/local/man/man3 -Duse64bitint -Dman1ext=1 -Dman3ext=3perl -Dpager=/usr/bin/sensible-pager -Uafs -Ud_csh -Ud_ualarm -Uusesfio -Uusenm -Ui_libutil -Ui_xlocale -Uversiononly -DDEBUGGING=-g -Doptimize=-O2 -dEs -Duseshrplib -Dlibperl=libperl.so.5.32.1' hint=recommended useposix=true d_sigaction=define useithreads=define usemultiplicity=define use64bitint=define use64bitall=define uselongdouble=undef usemymalloc=n default_inc_excludes_dot=define bincompat5005=undef Compiler: cc='x86_64-linux-gnu-gcc' ccflags ='-D_REENTRANT -D_GNU_SOURCE -DDEBIAN -fwrapv -fno-strict-aliasing -pipe -I/usr/local/include -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64' optimize='-O2 -g' cppflags='-D_REENTRANT -D_GNU_SOURCE -DDEBIAN -fwrapv -fno-strict-aliasing -pipe -I/usr/local/include' ccversion='' gccversion='11.2.0' gccosandvers='' intsize=4 longsize=8 ptrsize=8 doublesize=8 byteorder=12345678 doublekind=3 d_longlong=define longlongsize=8 d_longdbl=define longdblsize=16 longdblkind=3 ivtype='long' ivsize=8 nvtype='double' nvsize=8 Off_t='off_t' lseeksize=8 alignbytes=8 prototype=define Linker and Libraries: ld='x86_64-linux-gnu-gcc' ldflags =' -fstack-protector-strong -L/usr/local/lib' libpth=/usr/local/lib /usr/include/x86_64-linux-gnu /usr/lib /lib/x86_64-linux-gnu /lib/../lib /usr/lib/x86_64-linux-gnu /usr/lib/../lib /lib /lib64 /usr/lib64 libs=-lgdbm -lgdbm_compat -ldb -ldl -lm -lpthread -lc -lcrypt perllibs=-ldl -lm -lpthread -lc -lcrypt libc=libc-2.33.so so=so useshrplib=true libperl=libperl.so.5.32 gnulibc_version='2.33' Dynamic Linking: dlsrc=dl_dlopen.xs dlext=so d_dlsymun=undef ccdlflags='-Wl,-E' cccdlflags='-fPIC' lddlflags='-shared -L/usr/local/lib -fstack-protector-strong'
Characteristics of this binary (from libperl): Compile-time options: HAS_TIMES MULTIPLICITY PERLIO_LAYERS PERL_COPY_ON_WRITE PERL_DONT_CREATE_GVSV PERL_IMPLICIT_CONTEXT PERL_MALLOC_WRAP PERL_OP_PARENT PERL_PRESERVE_IVUV USE_64_BIT_ALL USE_64_BIT_INT USE_ITHREADS USE_LARGE_FILES USE_LOCALE USE_LOCALE_COLLATE USE_LOCALE_CTYPE USE_LOCALE_NUMERIC USE_LOCALE_TIME USE_PERLIO USE_PERL_ATOF USE_REENTRANT_API USE_THREAD_SAFE_LOCALE Locally applied patches: DEBPKG:debian/cpan_definstalldirs - Provide a sensible INSTALLDIRS default for modules installed from CPAN. DEBPKG:debian/db_file_ver - https://bugs.debian.org/340047 Remove overly restrictive DB_File version check. DEBPKG:debian/doc_info - Replace generic man(1) instructions with Debian-specific information. DEBPKG:debian/enc2xs_inc - https://bugs.debian.org/290336 Tweak enc2xs to follow symlinks and ignore missing @INC directories. DEBPKG:debian/errno_ver - https://bugs.debian.org/343351 Remove Errno version check due to upgrade problems with long-running processes. DEBPKG:debian/libperl_embed_doc - https://bugs.debian.org/186778 Note that libperl-dev package is required for embedded linking DEBPKG:fixes/respect_umask - Respect umask during installation DEBPKG:debian/writable_site_dirs - Set umask approproately for site install directories DEBPKG:debian/extutils_set_libperl_path - EU:MM: set location of libperl.a under /usr/lib DEBPKG:debian/no_packlist_perllocal - Don't install .packlist or perllocal.pod for perl or vendor DEBPKG:debian/fakeroot - Postpone LD_LIBRARY_PATH evaluation to the binary targets. DEBPKG:debian/instmodsh_doc - Debian policy doesn't install .packlist files for core or vendor. DEBPKG:debian/ld_run_path - Remove standard libs from LD_RUN_PATH as per Debian policy. DEBPKG:debian/libnet_config_path - Set location of libnet.cfg to /etc/perl/Net as /usr may not be writable. DEBPKG:debian/perlivp - https://bugs.debian.org/510895 Make perlivp skip include directories in /usr/local DEBPKG:debian/squelch-locale-warnings - https://bugs.debian.org/508764 Squelch locale warnings in Debian package maintainer scripts DEBPKG:debian/patchlevel - https://bugs.debian.org/567489 List packaged patches for 5.32.1-3ubuntu3 in patchlevel.h DEBPKG:fixes/document_makemaker_ccflags - https://bugs.debian.org/628522 [rt.cpan.org #68613] Document that CCFLAGS should include $Config{ccflags} DEBPKG:debian/find_html2text - https://bugs.debian.org/640479 Configure CPAN::Distribution with correct name of html2text DEBPKG:debian/perl5db-x-terminal-emulator.patch - https://bugs.debian.org/668490 Invoke x-terminal-emulator rather than xterm in perl5db.pl DEBPKG:debian/cpan-missing-site-dirs - https://bugs.debian.org/688842 Fix CPAN::FirstTime defaults with nonexisting site dirs if a parent is writable DEBPKG:fixes/memoize_storable_nstore - [rt.cpan.org #77790] https://bugs.debian.org/587650 Memoize::Storable: respect 'nstore' option not respected DEBPKG:debian/makemaker-pasthru - https://bugs.debian.org/758471 Pass LD settings through to subdirectories DEBPKG:debian/makemaker-manext - https://bugs.debian.org/247370 Make EU::MakeMaker honour MANnEXT settings in generated manpage headers DEBPKG:debian/kfreebsd-softupdates - https://bugs.debian.org/796798 Work around Debian Bug#796798 DEBPKG:fixes/memoize-pod - [rt.cpan.org #89441] Fix POD errors in Memoize DEBPKG:debian/hurd-softupdates - https://bugs.debian.org/822735 Fix t/op/stat.t failures on hurd DEBPKG:fixes/math_complex_doc_great_circle - https://bugs.debian.org/697567 [rt.cpan.org #114104] Math::Trig: clarify definition of great_circle_midpoint DEBPKG:fixes/math_complex_doc_see_also - https://bugs.debian.org/697568 [rt.cpan.org #114105] Math::Trig: add missing SEE ALSO DEBPKG:fixes/math_complex_doc_angle_units - https://bugs.debian.org/731505 [rt.cpan.org #114106] Math::Trig: document angle units DEBPKG:fixes/cpan_web_link - https://bugs.debian.org/367291 CPAN: Add link to main CPAN web site DEBPKG:debian/hppa_op_optimize_workaround - https://bugs.debian.org/838613 Temporarily lower the optimization of op.c on hppa due to gcc-6 problems DEBPKG:debian/installman-utf8 - https://bugs.debian.org/840211 Generate man pages with UTF-8 characters DEBPKG:debian/hppa_opmini_optimize_workaround - https://bugs.debian.org/869122 Lower the optimization level of opmini.c on hppa DEBPKG:debian/sh4_op_optimize_workaround - https://bugs.debian.org/869373 Also lower the optimization level of op.c and opmini.c on sh4 DEBPKG:debian/perldoc-pager - https://bugs.debian.org/870340 [ rt.cpan.org #120229] Fix perldoc terminal escapes when sensible-pager is less DEBPKG:debian/prune_libs - https://bugs.debian.org/128355 Prune the list of libraries wanted to what we actually need. DEBPKG:debian/mod_paths - Tweak @INC ordering for Debian DEBPKG:debian/configure-regen - https://bugs.debian.org/762638 Regenerate Configure et al. after probe unit changes DEBPKG:debian/deprecate-with-apt - https://bugs.debian.org/747628 Point users to Debian packages of deprecated core modules DEBPKG:debian/disable-stack-check - https://bugs.debian.org/902779 [GH #16607] Disable debugperl stack extension checks for binary compatibility with perl DEBPKG:debian/perlbug-editor - https://bugs.debian.org/922609 Use "editor" as the default perlbug editor, as per Debian policy DEBPKG:debian/eu-mm-perl-base - https://bugs.debian.org/962138 Suppress an ExtUtils::MakeMaker warning about our non-default @INC DEBPKG:fixes/hurd-cachepropagate-test-fix - https://bugs.debian.org/963214 GNU/Hurd doesn't support SO_PROTOCOL DEBPKG:fixes/io_socket_ip_ipv6 - Disable getaddrinfo(3) AI_ADDRCONFIG for localhost and IPv4 numeric addresses DEBPKG:disable-libperl-tests - DEBPKG:CVE-2021-36770.patch - [PATCH] mitigate @INC pollution when loading ConfigLocal Built under linux Compiled at Aug 2 2021 12:24:15 @INC: /etc/perl /usr/local/lib/x86_64-linux-gnu/perl/5.32.1 /usr/local/share/perl/5.32.1 /usr/lib/x86_64-linux-gnu/perl5/5.32 /usr/share/perl5 /usr/lib/x86_64-linux-gnu/perl-base /usr/lib/x86_64-linux-gnu/perl/5.32 /usr/share/perl/5.32 /usr/local/lib/site_perl
Any ideas how I could make it work?
Best Konrad
Hello Konrad,
Hmm, workedforme (not helpful I know), when I tested this last week on a Ubuntu 20.04 VM, which makes debugging this harder. No output at all is very strange. If you can try, does it work with any other OS?
Can you try thess command lines, which makes Perl enter Debug mode, and send the log file GetComponents.log that it produces, please?
export PERL5DB='sub DB::DB {my ($p, $f, $l) = caller;my $code = @{"::_<$f"};print STDERR ">> $f:$l: $code->[$l]";}'
(all in one line)
and
/usr/bin/perl -d ./GetComponents --parallel https://bitbucket.org/einsteintoolkit/manifest/raw/ET_2021_11/einsteintoolki... 2>&1 | tee GetComponents.log
(also a single line)
Yours, Roland
The directory structure on bitbucket.org has changed. I ran into the same problem.
cheers, Wayne
*************************************** Dr. Wayne Barkhouse Professor Department of Physics and Astrophysics University of North Dakota Grand Forks, ND 58202-7129
Email: wayne.barkhouse@und.edu Phone: 701-777-3520 FaX: 701-777-3523 ***************************************
________________________________ From: users-bounces@einsteintoolkit.org users-bounces@einsteintoolkit.org on behalf of Roland Haas rhaas@illinois.edu Sent: Monday, January 24, 2022 9:20 AM To: Konrad Topolski k.topolski2@student.uw.edu.pl Cc: Einstein Toolkit Users users@einsteintoolkit.org Subject: Re: [Users] GetComponents script not working
Hello Konrad,
Hmm, workedforme (not helpful I know), when I tested this last week on a Ubuntu 20.04 VM, which makes debugging this harder. No output at all is very strange. If you can try, does it work with any other OS?
Can you try thess command lines, which makes Perl enter Debug mode, and send the log file GetComponents.log that it produces, please?
export PERL5DB='sub DB::DB {my ($p, $f, $l) = caller;my $code = @{"::_<$f"};print STDERR ">> $f:$l: $code->[$l]";}'
(all in one line)
and
/usr/bin/perl -d ./GetComponents --parallel https://bitbucket.org/einsteintoolkit/manifest/raw/ET_2021_11/einsteintoolki... 2>&1 | tee GetComponents.log
(also a single line)
Yours, Roland
-- My email is as private as my paper mail. I therefore support encrypting and signing email messages. Get my PGP key from http://pgp.mit.edu .
What change are you referring to? Thanks.
--Steve
On 1/24/2022 9:21 AM, Barkhouse, Wayne wrote:
The directory structure on bitbucket.org has changed. I ran into the same problem.
cheers, Wayne
Dr. Wayne Barkhouse Professor Department of Physics and Astrophysics University of North Dakota Grand Forks, ND 58202-7129
Email: wayne.barkhouse@und.edu Phone: 701-777-3520 FaX: 701-777-3523
*From:* users-bounces@einsteintoolkit.org users-bounces@einsteintoolkit.org on behalf of Roland Haas rhaas@illinois.edu *Sent:* Monday, January 24, 2022 9:20 AM *To:* Konrad Topolski k.topolski2@student.uw.edu.pl *Cc:* Einstein Toolkit Users users@einsteintoolkit.org *Subject:* Re: [Users] GetComponents script not working Hello Konrad,
Hmm, workedforme (not helpful I know), when I tested this last week on a Ubuntu 20.04 VM, which makes debugging this harder. No output at all is very strange. If you can try, does it work with any other OS?
Can you try thess command lines, which makes Perl enter Debug mode, and send the log file GetComponents.log that it produces, please?
export PERL5DB='sub DB::DB {my ($p, $f, $l) = caller;my $code = @{"::_<$f"};print STDERR ">> $f:$l: $code->[$l]";}'
(all in one line)
and
/usr/bin/perl -d ./GetComponents --parallel https://bitbucket.org/einsteintoolkit/manifest/raw/ET_2021_11/einsteintoolki... 2>&1 | tee GetComponents.log
(also a single line)
Yours, Roland
-- My email is as private as my paper mail. I therefore support encrypting and signing email messages. Get my PGP key from http://pgp.mit.edu .
Users mailing list Users@einsteintoolkit.org http://lists.einsteintoolkit.org/mailman/listinfo/users
Thank you all for the responses.
@Steven, yes, the usual help message is printed out
@Roland, it works for my other machine, under Ubuntu 20.04 with 5.11 kernel, but the perl version I believe to be the same (perhaps the OS details are not relevant here at all); I'm sending the log in the attachments. It seems that the script hangs up at this point:
./GetComponents:580: $rec{"AUTH_URL_ORIG"} = $rec{"AUTH_URL"}; ./GetComponents:583: if ($ANONYMOUS_CHECKOUT) { ./GetComponents:584: delete $rec{AUTH_URL}; ./GetComponents:592: my @checkouts = split( /\s+/m,
$rec{"CHECKOUT"} );
./GetComponents:593: foreach my $checkout (@checkouts) { ./GetComponents:596: my ( $dir1, $dir2 ); ./GetComponents:597: if ( $checkout =~ m!/! ) { ./GetComponents:598: ( $dir1, $dir2 ) = $checkout =~
m!(.+)/(.+)!;
./GetComponents:603: if ( defined( $rec{URL} ) ) { ./GetComponents:604: $rec{URL} = $rec{"URL_ORIG"}; ./GetComponents:605: $rec{URL} =~ s!$1!$dir1!; ./GetComponents:606: $rec{URL} =~ s!$2!$dir2!; ./GetComponents:608: if ( defined( $rec{AUTH_URL} ) ) { ./GetComponents:616: if ( $rec{"TYPE"} eq "svn" ) { ./GetComponents:617: my $url = ($rec{"AUTH_URL"} or
$rec{"URL"});
./GetComponents:618: if ( $url =~ m!https://! ) { ./GetComponents:619: my $base = $url; ./GetComponents:620: $base =~
s/(https://[\w.]+)/(.*)$/$1/i;
./GetComponents:621: unless ( defined
$svn_servers{$base} ) {
./GetComponents:622: my $ret = `$svn
--non-interactive info $url 2>&1`;
Best regards Konrad
pon., 24 sty 2022 o 16:23 Steven R. Brandt sbrandt@cct.lsu.edu napisał(a):
What change are you referring to? Thanks.
--Steve
On 1/24/2022 9:21 AM, Barkhouse, Wayne wrote:
The directory structure on bitbucket.org has changed. I ran into the same problem.
cheers, Wayne
Dr. Wayne Barkhouse Professor Department of Physics and Astrophysics University of North Dakota Grand Forks, ND 58202-7129
Email: wayne.barkhouse@und.edu Phone: 701-777-3520 FaX: 701-777-3523
*From:* users-bounces@einsteintoolkit.org users-bounces@einsteintoolkit.org users-bounces@einsteintoolkit.org on behalf of Roland Haas rhaas@illinois.edu rhaas@illinois.edu *Sent:* Monday, January 24, 2022 9:20 AM *To:* Konrad Topolski k.topolski2@student.uw.edu.pl k.topolski2@student.uw.edu.pl *Cc:* Einstein Toolkit Users users@einsteintoolkit.org users@einsteintoolkit.org *Subject:* Re: [Users] GetComponents script not working
Hello Konrad,
Hmm, workedforme (not helpful I know), when I tested this last week on a Ubuntu 20.04 VM, which makes debugging this harder. No output at all is very strange. If you can try, does it work with any other OS?
Can you try thess command lines, which makes Perl enter Debug mode, and send the log file GetComponents.log that it produces, please?
export PERL5DB='sub DB::DB {my ($p, $f, $l) = caller;my $code = @{"::_<$f"};print STDERR ">> $f:$l: $code->[$l]";}'
(all in one line)
and
/usr/bin/perl -d ./GetComponents --parallel https://bitbucket.org/einsteintoolkit/manifest/raw/ET_2021_11/einsteintoolki... 2>&1 | tee GetComponents.log
(also a single line)
Yours, Roland
-- My email is as private as my paper mail. I therefore support encrypting and signing email messages. Get my PGP key from http://pgp.mit.edu .
Users mailing listUsers@einsteintoolkit.orghttp://lists.einsteintoolkit.org/mailman/listinfo/users
Users mailing list Users@einsteintoolkit.org http://lists.einsteintoolkit.org/mailman/listinfo/users
Ah, so it's subversion that's hanging. GetComponents should have a print statement before calling svn in verbose mode.
Could you add a print statement before line 622 so we can see the svn command with the $svn and $url expanded? Also, what is your svn version?
--Steve
On 1/24/2022 9:57 AM, Konrad Topolski wrote:
Thank you all for the responses.
@Steven, yes, the usual help message is printed out
@Roland, it works for my other machine, under Ubuntu 20.04 with 5.11 kernel, but the perl version I believe to be the same (perhaps the OS details are not relevant here at all); I'm sending the log in the attachments. It seems that the script hangs up at this point:
./GetComponents:580: $rec{"AUTH_URL_ORIG"} = $rec{"AUTH_URL"}; ./GetComponents:583: if ($ANONYMOUS_CHECKOUT) { ./GetComponents:584: delete $rec{AUTH_URL}; ./GetComponents:592: my @checkouts = split( /\s+/m,
$rec{"CHECKOUT"} );
./GetComponents:593: foreach my $checkout (@checkouts) { ./GetComponents:596: my ( $dir1, $dir2 ); ./GetComponents:597: if ( $checkout =~ m!/! ) { ./GetComponents:598: ( $dir1, $dir2 ) = $checkout
=~ m!(.+)/(.+)!;
./GetComponents:603: if ( defined( $rec{URL} ) ) { ./GetComponents:604: $rec{URL} = $rec{"URL_ORIG"}; ./GetComponents:605: $rec{URL} =~ s!$1!$dir1!; ./GetComponents:606: $rec{URL} =~ s!$2!$dir2!; ./GetComponents:608: if ( defined( $rec{AUTH_URL} ) ) { ./GetComponents:616: if ( $rec{"TYPE"} eq "svn" ) { ./GetComponents:617: my $url = ($rec{"AUTH_URL"} or
$rec{"URL"});
./GetComponents:618: if ( $url =~ m!https://! ) { ./GetComponents:619: my $base = $url; ./GetComponents:620: $base =~
s/(https://[\w.]+)/(.*)$/$1/i;
./GetComponents:621: unless ( defined
$svn_servers{$base} ) {
./GetComponents:622: my $ret = `$svn
--non-interactive info $url 2>&1`;
Best regards Konrad
pon., 24 sty 2022 o 16:23 Steven R. Brandt sbrandt@cct.lsu.edu napisał(a):
What change are you referring to? Thanks. --Steve On 1/24/2022 9:21 AM, Barkhouse, Wayne wrote:The directory structure on bitbucket.org <http://bitbucket.org> has changed. I ran into the same problem. cheers, Wayne *************************************** Dr. Wayne Barkhouse Professor Department of Physics and Astrophysics University of North Dakota Grand Forks, ND 58202-7129 Email: wayne.barkhouse@und.edu Phone: 701-777-3520 FaX: 701-777-3523 *************************************** ------------------------------------------------------------------------ *From:* users-bounces@einsteintoolkit.org <users-bounces@einsteintoolkit.org> <mailto:users-bounces@einsteintoolkit.org> on behalf of Roland Haas <rhaas@illinois.edu> <mailto:rhaas@illinois.edu> *Sent:* Monday, January 24, 2022 9:20 AM *To:* Konrad Topolski <k.topolski2@student.uw.edu.pl> <mailto:k.topolski2@student.uw.edu.pl> *Cc:* Einstein Toolkit Users <users@einsteintoolkit.org> <mailto:users@einsteintoolkit.org> *Subject:* Re: [Users] GetComponents script not working Hello Konrad, Hmm, workedforme (not helpful I know), when I tested this last week on a Ubuntu 20.04 VM, which makes debugging this harder. No output at all is very strange. If you can try, does it work with any other OS? Can you try thess command lines, which makes Perl enter Debug mode, and send the log file GetComponents.log that it produces, please? export PERL5DB='sub DB::DB {my ($p, $f, $l) = caller;my $code = \@{"::_<$f"};print STDERR ">> $f:$l: $code->[$l]";}' (all in one line) and /usr/bin/perl -d ./GetComponents --parallel https://bitbucket.org/einsteintoolkit/manifest/raw/ET_2021_11/einsteintoolkit.th 2>&1 | tee GetComponents.log (also a single line) Yours, Roland -- My email is as private as my paper mail. I therefore support encrypting and signing email messages. Get my PGP key from http://pgp.mit.edu . _______________________________________________ Users mailing list Users@einsteintoolkit.org http://lists.einsteintoolkit.org/mailman/listinfo/users_______________________________________________ Users mailing list Users@einsteintoolkit.org http://lists.einsteintoolkit.org/mailman/listinfo/users
Users mailing list Users@einsteintoolkit.org http://lists.einsteintoolkit.org/mailman/listinfo/users
I hope that's what you meant (I'm not familiar with perl at all): I added the lines: print("DEBUG LINE, print: $url\n"); print("DEBUG LINE, print: $svn\n"); before: my $ret = `$svn --non-interactive info $url 2>&1`; *(line 622)*
The output changes, in the relevant lines:
./GetComponents:620: $base =~
s/(https://[\w.]+)/(.*)$/$1/i;
./GetComponents:621: unless ( defined
$svn_servers{$base} ) {
./GetComponents:622: print("DEBUG LINE, print: $url\n"); ./GetComponents:623: print("DEBUG LINE, print:
$svn\n");
./GetComponents:624: my $ret = `$svn
--non-interactive info $url 2>&1`; DEBUG LINE, print: https://github.com/EinsteinToolkit/ExternalLibraries-OpenBLAS.git/branches/E... DEBUG LINE, print: svn
My *svn *is: ($svn --version)
svn, version 1.14.1 (r1886195) compiled Dec 3 2021, 20:03:34 on x86_64-pc-linux-gnu The following repository access (RA) modules are available:
* ra_svn : Module for accessing a repository using the svn network protocol. - with Cyrus SASL authentication - handles 'svn' scheme * ra_local : Module for accessing a repository on local disk. - handles 'file' scheme * ra_serf : Module for accessing a repository via WebDAV protocol using serf. - using serf 1.3.9 (compiled with 1.3.9) - handles 'http' scheme - handles 'https' scheme
The following authentication credential caches are available:
* Gnome Keyring * GPG-Agent * KWallet (KDE)
Could I be missing some dependencies? Best Konrad
pon., 24 sty 2022 o 17:16 Steven R. Brandt sbrandt@cct.lsu.edu napisał(a):
Ah, so it's subversion that's hanging. GetComponents should have a print statement before calling svn in verbose mode.
Could you add a print statement before line 622 so we can see the svn command with the $svn and $url expanded? Also, what is your svn version?
--Steve On 1/24/2022 9:57 AM, Konrad Topolski wrote:
Thank you all for the responses.
@Steven, yes, the usual help message is printed out
@Roland, it works for my other machine, under Ubuntu 20.04 with 5.11 kernel, but the perl version I believe to be the same (perhaps the OS details are not relevant here at all); I'm sending the log in the attachments. It seems that the script hangs up at this point:
./GetComponents:580: $rec{"AUTH_URL_ORIG"} = $rec{"AUTH_URL"}; ./GetComponents:583: if ($ANONYMOUS_CHECKOUT) { ./GetComponents:584: delete $rec{AUTH_URL}; ./GetComponents:592: my @checkouts = split( /\s+/m,
$rec{"CHECKOUT"} );
./GetComponents:593: foreach my $checkout (@checkouts) { ./GetComponents:596: my ( $dir1, $dir2 ); ./GetComponents:597: if ( $checkout =~ m!/! ) { ./GetComponents:598: ( $dir1, $dir2 ) = $checkout =~
m!(.+)/(.+)!;
./GetComponents:603: if ( defined( $rec{URL} ) ) { ./GetComponents:604: $rec{URL} = $rec{"URL_ORIG"}; ./GetComponents:605: $rec{URL} =~ s!$1!$dir1!; ./GetComponents:606: $rec{URL} =~ s!$2!$dir2!; ./GetComponents:608: if ( defined( $rec{AUTH_URL} ) ) { ./GetComponents:616: if ( $rec{"TYPE"} eq "svn" ) { ./GetComponents:617: my $url = ($rec{"AUTH_URL"} or
$rec{"URL"});
./GetComponents:618: if ( $url =~ m!https://! ) { ./GetComponents:619: my $base = $url; ./GetComponents:620: $base =~
s/(https://[\w.]+)/(.*)$/$1/i;
./GetComponents:621: unless ( defined
$svn_servers{$base} ) {
./GetComponents:622: my $ret = `$svn
--non-interactive info $url 2>&1`;
Best regards Konrad
pon., 24 sty 2022 o 16:23 Steven R. Brandt sbrandt@cct.lsu.edu napisał(a):
What change are you referring to? Thanks.
--Steve
On 1/24/2022 9:21 AM, Barkhouse, Wayne wrote:
The directory structure on bitbucket.org has changed. I ran into the same problem.
cheers, Wayne
Dr. Wayne Barkhouse Professor Department of Physics and Astrophysics University of North Dakota Grand Forks, ND 58202-7129
Email: wayne.barkhouse@und.edu Phone: 701-777-3520 FaX: 701-777-3523
*From:* users-bounces@einsteintoolkit.org users-bounces@einsteintoolkit.org users-bounces@einsteintoolkit.org on behalf of Roland Haas rhaas@illinois.edu rhaas@illinois.edu *Sent:* Monday, January 24, 2022 9:20 AM *To:* Konrad Topolski k.topolski2@student.uw.edu.pl k.topolski2@student.uw.edu.pl *Cc:* Einstein Toolkit Users users@einsteintoolkit.org users@einsteintoolkit.org *Subject:* Re: [Users] GetComponents script not working
Hello Konrad,
Hmm, workedforme (not helpful I know), when I tested this last week on a Ubuntu 20.04 VM, which makes debugging this harder. No output at all is very strange. If you can try, does it work with any other OS?
Can you try thess command lines, which makes Perl enter Debug mode, and send the log file GetComponents.log that it produces, please?
export PERL5DB='sub DB::DB {my ($p, $f, $l) = caller;my $code = @{"::_<$f"};print STDERR ">> $f:$l: $code->[$l]";}'
(all in one line)
and
/usr/bin/perl -d ./GetComponents --parallel https://bitbucket.org/einsteintoolkit/manifest/raw/ET_2021_11/einsteintoolki... 2>&1 | tee GetComponents.log
(also a single line)
Yours, Roland
-- My email is as private as my paper mail. I therefore support encrypting and signing email messages. Get my PGP key from http://pgp.mit.edu .
Users mailing listUsers@einsteintoolkit.orghttp://lists.einsteintoolkit.org/mailman/listinfo/users
Users mailing list Users@einsteintoolkit.org http://lists.einsteintoolkit.org/mailman/listinfo/users
Users mailing listUsers@einsteintoolkit.orghttp://lists.einsteintoolkit.org/mailman/listinfo/users
Users mailing list Users@einsteintoolkit.org http://lists.einsteintoolkit.org/mailman/listinfo/users
Hello Konrad,
It could be an isntance of this old bug:
https://bitbucket.org/einsteintoolkit/tickets/issues/68/getcomponents-non-in...
in which case you can try a single manual check once just to get certificates right:
svn info https://github.com/EinsteinToolkit/ExternalLibraries-MPI.git/trunk
and / or
svn checkout https://github.com/EinsteinToolkit/ExternalLibraries-MPI.git/trunk DELETEME
(and then remove the dummy DELETEME checkout).
Just why only your single Ubuntu system is affected I cannot tell though (given that I purposely test these things on freshly installed VMs so there is no "baggage" like there is on my actual workstation where I may well have accepted all kinds of odd certificates for svn in the past).
Yours, Roland
I hope that's what you meant (I'm not familiar with perl at all): I added the lines: print("DEBUG LINE, print: $url\n"); print("DEBUG LINE, print: $svn\n"); before: my $ret = `$svn --non-interactive info $url 2>&1`; *(line 622)*
The output changes, in the relevant lines:
./GetComponents:620: $base =~
s/(https://[\w.]+)/(.*)$/$1/i;
./GetComponents:621: unless ( defined
$svn_servers{$base} ) {
./GetComponents:622: print("DEBUG LINE, print: $url\n"); ./GetComponents:623: print("DEBUG LINE, print:
$svn\n");
./GetComponents:624: my $ret = `$svn
--non-interactive info $url 2>&1`; DEBUG LINE, print: https://urldefense.com/v3/__https://github.com/EinsteinToolkit/ExternalLibra... DEBUG LINE, print: svn
My *svn *is: ($svn --version)
svn, version 1.14.1 (r1886195) compiled Dec 3 2021, 20:03:34 on x86_64-pc-linux-gnu The following repository access (RA) modules are available:
- ra_svn : Module for accessing a repository using the svn network protocol.
- with Cyrus SASL authentication
- handles 'svn' scheme
- ra_local : Module for accessing a repository on local disk.
- handles 'file' scheme
- ra_serf : Module for accessing a repository via WebDAV protocol using
serf.
- using serf 1.3.9 (compiled with 1.3.9)
- handles 'http' scheme
- handles 'https' scheme
The following authentication credential caches are available:
- Gnome Keyring
- GPG-Agent
- KWallet (KDE)
Could I be missing some dependencies? Best Konrad
pon., 24 sty 2022 o 17:16 Steven R. Brandt sbrandt@cct.lsu.edu napisał(a):
Ah, so it's subversion that's hanging. GetComponents should have a print statement before calling svn in verbose mode.
Could you add a print statement before line 622 so we can see the svn command with the $svn and $url expanded? Also, what is your svn version?
--Steve On 1/24/2022 9:57 AM, Konrad Topolski wrote:
Thank you all for the responses.
@Steven, yes, the usual help message is printed out
@Roland, it works for my other machine, under Ubuntu 20.04 with 5.11 kernel, but the perl version I believe to be the same (perhaps the OS details are not relevant here at all); I'm sending the log in the attachments. It seems that the script hangs up at this point:
./GetComponents:580: $rec{"AUTH_URL_ORIG"} = $rec{"AUTH_URL"}; ./GetComponents:583: if ($ANONYMOUS_CHECKOUT) { ./GetComponents:584: delete $rec{AUTH_URL}; ./GetComponents:592: my @checkouts = split( /\s+/m,
$rec{"CHECKOUT"} );
./GetComponents:593: foreach my $checkout (@checkouts) { ./GetComponents:596: my ( $dir1, $dir2 ); ./GetComponents:597: if ( $checkout =~ m!/! ) { ./GetComponents:598: ( $dir1, $dir2 ) = $checkout =~
m!(.+)/(.+)!;
./GetComponents:603: if ( defined( $rec{URL} ) ) { ./GetComponents:604: $rec{URL} = $rec{"URL_ORIG"}; ./GetComponents:605: $rec{URL} =~ s!$1!$dir1!; ./GetComponents:606: $rec{URL} =~ s!$2!$dir2!; ./GetComponents:608: if ( defined( $rec{AUTH_URL} ) ) { ./GetComponents:616: if ( $rec{"TYPE"} eq "svn" ) { ./GetComponents:617: my $url = ($rec{"AUTH_URL"} or
$rec{"URL"});
./GetComponents:618: if ( $url =~ m!https://urldefense.com/v3/__https://!__;!!DZ3fjg!sgmk8gw7jV_rep-HkLhKJonwEpG... ) { ./GetComponents:619: my $base = $url; ./GetComponents:620: $base =~
s/(https://[\w.]+)/(.*)$/$1/i;
./GetComponents:621: unless ( defined
$svn_servers{$base} ) {
./GetComponents:622: my $ret = `$svn
--non-interactive info $url 2>&1`;
Best regards Konrad
pon., 24 sty 2022 o 16:23 Steven R. Brandt sbrandt@cct.lsu.edu napisał(a):
What change are you referring to? Thanks.
--Steve
On 1/24/2022 9:21 AM, Barkhouse, Wayne wrote:
The directory structure on bitbucket.org has changed. I ran into the same problem.
cheers, Wayne
Dr. Wayne Barkhouse Professor Department of Physics and Astrophysics University of North Dakota Grand Forks, ND 58202-7129
Email: wayne.barkhouse@und.edu Phone: 701-777-3520 FaX: 701-777-3523
*From:* users-bounces@einsteintoolkit.org users-bounces@einsteintoolkit.org users-bounces@einsteintoolkit.org on behalf of Roland Haas rhaas@illinois.edu rhaas@illinois.edu *Sent:* Monday, January 24, 2022 9:20 AM *To:* Konrad Topolski k.topolski2@student.uw.edu.pl k.topolski2@student.uw.edu.pl *Cc:* Einstein Toolkit Users users@einsteintoolkit.org users@einsteintoolkit.org *Subject:* Re: [Users] GetComponents script not working
Hello Konrad,
Hmm, workedforme (not helpful I know), when I tested this last week on a Ubuntu 20.04 VM, which makes debugging this harder. No output at all is very strange. If you can try, does it work with any other OS?
Can you try thess command lines, which makes Perl enter Debug mode, and send the log file GetComponents.log that it produces, please?
export PERL5DB='sub DB::DB {my ($p, $f, $l) = caller;my $code = @{"::_<$f"};print STDERR ">> $f:$l: $code->[$l]";}'
(all in one line)
and
/usr/bin/perl -d ./GetComponents --parallel https://urldefense.com/v3/__https://bitbucket.org/einsteintoolkit/manifest/r... 2>&1 | tee GetComponents.log
(also a single line)
Yours, Roland
-- My email is as private as my paper mail. I therefore support encrypting and signing email messages. Get my PGP key from https://urldefense.com/v3/__http://pgp.mit.edu__;!!DZ3fjg!sgmk8gw7jV_rep-HkL... .
Users mailing listUsers@einsteintoolkit.orghttp://lists.einsteintoolkit.org/mailman/listinfo/users
Users mailing list Users@einsteintoolkit.org https://urldefense.com/v3/__http://lists.einsteintoolkit.org/mailman/listinf...
Users mailing listUsers@einsteintoolkit.orghttp://lists.einsteintoolkit.org/mailman/listinfo/users
Users mailing list Users@einsteintoolkit.org https://urldefense.com/v3/__http://lists.einsteintoolkit.org/mailman/listinf...
Hi Roland
What would you suggest to do in the unfortunate case that I'm not getting any output from
svn info https://github.com/EinsteinToolkit/ExternalLibraries-MPI.git/trunk
and neither from
svn checkout https://github.com/EinsteinToolkit/ExternalLibraries-MPI.git/trunk DELETEME ?
I can use the other machine to pull everything of course, but perhaps there's yet some fix that I could try?
Best Konrad
wt., 25 sty 2022 o 16:40 Roland Haas rhaas@illinois.edu napisał(a):
Hello Konrad,
It could be an isntance of this old bug:
https://bitbucket.org/einsteintoolkit/tickets/issues/68/getcomponents-non-in...
in which case you can try a single manual check once just to get certificates right:
svn info https://github.com/EinsteinToolkit/ExternalLibraries-MPI.git/trunk
and / or
svn checkout https://github.com/EinsteinToolkit/ExternalLibraries-MPI.git/trunk DELETEME
(and then remove the dummy DELETEME checkout).
Just why only your single Ubuntu system is affected I cannot tell though (given that I purposely test these things on freshly installed VMs so there is no "baggage" like there is on my actual workstation where I may well have accepted all kinds of odd certificates for svn in the past).
Yours, Roland
I hope that's what you meant (I'm not familiar with perl at all): I added the lines: print("DEBUG LINE, print: $url\n"); print("DEBUG LINE, print: $svn\n"); before: my $ret = `$svn --non-interactive info $url 2>&1`; *(line 622)*
The output changes, in the relevant lines:
./GetComponents:620: $base =~
s/(https://[\w.]+)/(.*)$/$1/i;
./GetComponents:621: unless ( defined
$svn_servers{$base} ) {
./GetComponents:622: print("DEBUG LINE, print: $url\n"); ./GetComponents:623: print("DEBUG LINE,
print:
$svn\n");
./GetComponents:624: my $ret = `$svn
--non-interactive info $url 2>&1`; DEBUG LINE, print:
https://urldefense.com/v3/__https://github.com/EinsteinToolkit/ExternalLibra...
DEBUG LINE, print: svn
My *svn *is: ($svn --version)
svn, version 1.14.1 (r1886195) compiled Dec 3 2021, 20:03:34 on x86_64-pc-linux-gnu The following repository access (RA) modules are available:
- ra_svn : Module for accessing a repository using the svn network
protocol.
- with Cyrus SASL authentication
- handles 'svn' scheme
- ra_local : Module for accessing a repository on local disk.
- handles 'file' scheme
- ra_serf : Module for accessing a repository via WebDAV protocol using
serf.
- using serf 1.3.9 (compiled with 1.3.9)
- handles 'http' scheme
- handles 'https' scheme
The following authentication credential caches are available:
- Gnome Keyring
- GPG-Agent
- KWallet (KDE)
Could I be missing some dependencies? Best Konrad
pon., 24 sty 2022 o 17:16 Steven R. Brandt sbrandt@cct.lsu.edu
napisał(a):
Ah, so it's subversion that's hanging. GetComponents should have a
statement before calling svn in verbose mode.
Could you add a print statement before line 622 so we can see the svn command with the $svn and $url expanded? Also, what is your svn
version?
--Steve On 1/24/2022 9:57 AM, Konrad Topolski wrote:
Thank you all for the responses.
@Steven, yes, the usual help message is printed out
@Roland, it works for my other machine, under Ubuntu 20.04 with 5.11 kernel, but the perl version I believe to be the same (perhaps the OS details are not relevant here at all); I'm sending the log in the attachments. It seems that the script hangs up at this point:
./GetComponents:580: $rec{"AUTH_URL_ORIG"} =
$rec{"AUTH_URL"};
./GetComponents:583: if ($ANONYMOUS_CHECKOUT) { ./GetComponents:584: delete $rec{AUTH_URL}; ./GetComponents:592: my @checkouts = split( /\s+/m,
$rec{"CHECKOUT"} );
./GetComponents:593: foreach my $checkout (@checkouts) { ./GetComponents:596: my ( $dir1, $dir2 ); ./GetComponents:597: if ( $checkout =~ m!/! ) { ./GetComponents:598: ( $dir1, $dir2 ) = $checkout
=~
m!(.+)/(.+)!;
./GetComponents:603: if ( defined( $rec{URL} ) ) { ./GetComponents:604: $rec{URL} = $rec{"URL_ORIG"}; ./GetComponents:605: $rec{URL} =~ s!$1!$dir1!; ./GetComponents:606: $rec{URL} =~ s!$2!$dir2!; ./GetComponents:608: if ( defined( $rec{AUTH_URL} ) ) { ./GetComponents:616: if ( $rec{"TYPE"} eq "svn" ) { ./GetComponents:617: my $url = ($rec{"AUTH_URL"}
or
$rec{"URL"});
./GetComponents:618: if ( $url =~ m!
https://urldefense.com/v3/__https://!__;!!DZ3fjg!sgmk8gw7jV_rep-HkLhKJonwEpG... ) {
./GetComponents:619: my $base = $url; ./GetComponents:620: $base =~
s/(https://[\w.]+)/(.*)$/$1/i;
./GetComponents:621: unless ( defined
$svn_servers{$base} ) {
./GetComponents:622: my $ret = `$svn
--non-interactive info $url 2>&1`;
Best regards Konrad
pon., 24 sty 2022 o 16:23 Steven R. Brandt sbrandt@cct.lsu.edu napisał(a):
What change are you referring to? Thanks.
--Steve
On 1/24/2022 9:21 AM, Barkhouse, Wayne wrote:
The directory structure on bitbucket.org has changed. I ran into the same problem.
cheers, Wayne
Dr. Wayne Barkhouse Professor Department of Physics and Astrophysics University of North Dakota Grand Forks, ND 58202-7129
Email: wayne.barkhouse@und.edu Phone: 701-777-3520 FaX: 701-777-3523
*From:* users-bounces@einsteintoolkit.org users-bounces@einsteintoolkit.org <
users-bounces@einsteintoolkit.org>
on behalf of Roland Haas rhaas@illinois.edu rhaas@illinois.edu *Sent:* Monday, January 24, 2022 9:20 AM *To:* Konrad Topolski k.topolski2@student.uw.edu.pl k.topolski2@student.uw.edu.pl *Cc:* Einstein Toolkit Users users@einsteintoolkit.org users@einsteintoolkit.org *Subject:* Re: [Users] GetComponents script not working
Hello Konrad,
Hmm, workedforme (not helpful I know), when I tested this last week on a Ubuntu 20.04 VM, which makes debugging this harder. No output at all is very strange. If you can try, does it work with any other OS?
Can you try thess command lines, which makes Perl enter Debug mode,
and
send the log file GetComponents.log that it produces, please?
export PERL5DB='sub DB::DB {my ($p, $f, $l) = caller;my $code = @{"::_<$f"};print STDERR ">> $f:$l: $code->[$l]";}'
(all in one line)
and
/usr/bin/perl -d ./GetComponents --parallel
https://urldefense.com/v3/__https://bitbucket.org/einsteintoolkit/manifest/r...
2>&1 | tee GetComponents.log
(also a single line)
Yours, Roland
-- My email is as private as my paper mail. I therefore support
encrypting
and signing email messages. Get my PGP key from
https://urldefense.com/v3/__http://pgp.mit.edu__;!!DZ3fjg!sgmk8gw7jV_rep-HkL... .
Users mailing listUsers@einsteintoolkit.orghttp://
lists.einsteintoolkit.org/mailman/listinfo/users
Users mailing list Users@einsteintoolkit.org
https://urldefense.com/v3/__http://lists.einsteintoolkit.org/mailman/listinf...
Users mailing listUsers@einsteintoolkit.orghttp://
lists.einsteintoolkit.org/mailman/listinfo/users
Users mailing list Users@einsteintoolkit.org
https://urldefense.com/v3/__http://lists.einsteintoolkit.org/mailman/listinf...
-- My email is as private as my paper mail. I therefore support encrypting and signing email messages. Get my PGP key from http://pgp.mit.edu .
Hello Konrad,
I can use the other machine to pull everything of course, but perhaps there's yet some fix that I could try?
The simplest fix is most likely to change einsteintoolkit.th in this manner:
* replace all TYPE=svn by TYPE=git * remove all /branches/$ET_RELEASE and /trunk (whichever one is present)
Run GetComponents with the edited thorn list.
This will get the full git checkout so is a bit larger, but avoids svn issues with GitHub and Ubuntu. You may be seeing an instance of this:
https://bitbucket.org/einsteintoolkit/tickets/issues/2396/potential-issue-wi...
though there at least some output was produced.
Yours, Roland
btw, why is svn still needed? I see that it is only used for ExternalLibraries which are anyway in a git repository (is it because of the particular directory structure of that repository?).
Il giorno lun 24 gen 2022 alle ore 17:16 Steven R. Brandt < sbrandt@cct.lsu.edu> ha scritto:
Ah, so it's subversion that's hanging. GetComponents should have a print statement before calling svn in verbose mode.
Could you add a print statement before line 622 so we can see the svn command with the $svn and $url expanded? Also, what is your svn version?
--Steve On 1/24/2022 9:57 AM, Konrad Topolski wrote:
Thank you all for the responses.
@Steven, yes, the usual help message is printed out
@Roland, it works for my other machine, under Ubuntu 20.04 with 5.11 kernel, but the perl version I believe to be the same (perhaps the OS details are not relevant here at all); I'm sending the log in the attachments. It seems that the script hangs up at this point:
./GetComponents:580: $rec{"AUTH_URL_ORIG"} = $rec{"AUTH_URL"}; ./GetComponents:583: if ($ANONYMOUS_CHECKOUT) { ./GetComponents:584: delete $rec{AUTH_URL}; ./GetComponents:592: my @checkouts = split( /\s+/m,
$rec{"CHECKOUT"} );
./GetComponents:593: foreach my $checkout (@checkouts) { ./GetComponents:596: my ( $dir1, $dir2 ); ./GetComponents:597: if ( $checkout =~ m!/! ) { ./GetComponents:598: ( $dir1, $dir2 ) = $checkout =~
m!(.+)/(.+)!;
./GetComponents:603: if ( defined( $rec{URL} ) ) { ./GetComponents:604: $rec{URL} = $rec{"URL_ORIG"}; ./GetComponents:605: $rec{URL} =~ s!$1!$dir1!; ./GetComponents:606: $rec{URL} =~ s!$2!$dir2!; ./GetComponents:608: if ( defined( $rec{AUTH_URL} ) ) { ./GetComponents:616: if ( $rec{"TYPE"} eq "svn" ) { ./GetComponents:617: my $url = ($rec{"AUTH_URL"} or
$rec{"URL"});
./GetComponents:618: if ( $url =~ m!https://! ) { ./GetComponents:619: my $base = $url; ./GetComponents:620: $base =~
s/(https://[\w.]+)/(.*)$/$1/i;
./GetComponents:621: unless ( defined
$svn_servers{$base} ) {
./GetComponents:622: my $ret = `$svn
--non-interactive info $url 2>&1`;
Best regards Konrad
pon., 24 sty 2022 o 16:23 Steven R. Brandt sbrandt@cct.lsu.edu napisał(a):
What change are you referring to? Thanks.
--Steve
On 1/24/2022 9:21 AM, Barkhouse, Wayne wrote:
The directory structure on bitbucket.org has changed. I ran into the same problem.
cheers, Wayne
Dr. Wayne Barkhouse Professor Department of Physics and Astrophysics University of North Dakota Grand Forks, ND 58202-7129
Email: wayne.barkhouse@und.edu Phone: 701-777-3520 FaX: 701-777-3523
*From:* users-bounces@einsteintoolkit.org users-bounces@einsteintoolkit.org users-bounces@einsteintoolkit.org on behalf of Roland Haas rhaas@illinois.edu rhaas@illinois.edu *Sent:* Monday, January 24, 2022 9:20 AM *To:* Konrad Topolski k.topolski2@student.uw.edu.pl k.topolski2@student.uw.edu.pl *Cc:* Einstein Toolkit Users users@einsteintoolkit.org users@einsteintoolkit.org *Subject:* Re: [Users] GetComponents script not working
Hello Konrad,
Hmm, workedforme (not helpful I know), when I tested this last week on a Ubuntu 20.04 VM, which makes debugging this harder. No output at all is very strange. If you can try, does it work with any other OS?
Can you try thess command lines, which makes Perl enter Debug mode, and send the log file GetComponents.log that it produces, please?
export PERL5DB='sub DB::DB {my ($p, $f, $l) = caller;my $code = @{"::_<$f"};print STDERR ">> $f:$l: $code->[$l]";}'
(all in one line)
and
/usr/bin/perl -d ./GetComponents --parallel https://bitbucket.org/einsteintoolkit/manifest/raw/ET_2021_11/einsteintoolki... 2>&1 | tee GetComponents.log
(also a single line)
Yours, Roland
-- My email is as private as my paper mail. I therefore support encrypting and signing email messages. Get my PGP key from http://pgp.mit.edu .
Users mailing listUsers@einsteintoolkit.orghttp://lists.einsteintoolkit.org/mailman/listinfo/users
Users mailing list Users@einsteintoolkit.org http://lists.einsteintoolkit.org/mailman/listinfo/users
Users mailing listUsers@einsteintoolkit.orghttp://lists.einsteintoolkit.org/mailman/listinfo/users
Users mailing list Users@einsteintoolkit.org http://lists.einsteintoolkit.org/mailman/listinfo/users
Hello Bruno,
btw, why is svn still needed? I see that it is only used for ExternalLibraries which are anyway in a git repository (is it because of the particular directory structure of that repository?).
Not so much because of the directory structure but because of the content. We use svn for the ExternalLibraries thorns, which contain a tarball of the library (in case no copy is found on the system).
Since git downloads the full version history (by default, and shallow, --depth 1 checkouts do not work for us when using branches) we did not want to use git for those (since eg the MPI ExternalLibrary repo is ~172MB of "old" commits and ~10MB of checked out files. svn can download a single revision more easily.
Yours, Roland
Maybe it makes sense to use "--depth 1" on our git checkouts by default?
--Steve
On 1/24/2022 12:40 PM, Roland Haas wrote:
Hello Bruno,
btw, why is svn still needed? I see that it is only used for ExternalLibraries which are anyway in a git repository (is it because of the particular directory structure of that repository?).
Not so much because of the directory structure but because of the content. We use svn for the ExternalLibraries thorns, which contain a tarball of the library (in case no copy is found on the system).
Since git downloads the full version history (by default, and shallow, --depth 1 checkouts do not work for us when using branches) we did not want to use git for those (since eg the MPI ExternalLibrary repo is ~172MB of "old" commits and ~10MB of checked out files. svn can download a single revision more easily.
Yours, Roland
Roland, thanks for the explanation.
Cheers, Bruno
Il giorno lun 24 gen 2022 alle ore 19:40 Roland Haas rhaas@illinois.edu ha scritto:
Hello Bruno,
btw, why is svn still needed? I see that it is only used for ExternalLibraries which are anyway in a git repository (is it because of the particular directory structure of that repository?).
Not so much because of the directory structure but because of the content. We use svn for the ExternalLibraries thorns, which contain a tarball of the library (in case no copy is found on the system).
Since git downloads the full version history (by default, and shallow, --depth 1 checkouts do not work for us when using branches) we did not want to use git for those (since eg the MPI ExternalLibrary repo is ~172MB of "old" commits and ~10MB of checked out files. svn can download a single revision more easily.
Yours, Roland
-- My email is as private as my paper mail. I therefore support encrypting and signing email messages. Get my PGP key from http://pgp.mit.edu .
This may not be your issue, but if you are running Ubuntu under windows (WSL),, sometimes the ability to access external internet stops working and you need to reboot.
--Steve
On 1/24/2022 9:20 AM, Roland Haas wrote:
Hello Konrad,
Hmm, workedforme (not helpful I know), when I tested this last week on a Ubuntu 20.04 VM, which makes debugging this harder. No output at all is very strange. If you can try, does it work with any other OS?
Can you try thess command lines, which makes Perl enter Debug mode, and send the log file GetComponents.log that it produces, please?
export PERL5DB='sub DB::DB {my ($p, $f, $l) = caller;my $code = @{"::_<$f"};print STDERR ">> $f:$l: $code->[$l]";}'
(all in one line)
and
/usr/bin/perl -d ./GetComponents --parallel https://bitbucket.org/einsteintoolkit/manifest/raw/ET_2021_11/einsteintoolki... 2>&1 | tee GetComponents.log
(also a single line)
Yours, Roland
Users mailing list Users@einsteintoolkit.org http://lists.einsteintoolkit.org/mailman/listinfo/users
users@lists.einsteintoolkit.org
-
Barkhouse, Wayne -
Bruno Giacomazzo -
Konrad Topolski -
Roland Haas -
Steven R. Brandt