Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make bulk_extractor compile under Debian #452

Open
simsong opened this issue Jan 26, 2024 · 22 comments
Open

Make bulk_extractor compile under Debian #452

simsong opened this issue Jan 26, 2024 · 22 comments
Assignees
Labels

Comments

@simsong
Copy link
Owner

simsong commented Jan 26, 2024

@zdavatz -This is for you.
@simsong will use this distribution: https://aws.amazon.com/marketplace/pp/prodview-fznsw3f7mq7to

@simsong simsong added the bug label Jan 26, 2024
@simsong simsong self-assigned this Jan 26, 2024
@zdavatz
Copy link

zdavatz commented Jan 26, 2024

Yes, also on Gentoo the compilation from source is not straight forward.

@simsong
Copy link
Owner Author

simsong commented Jan 27, 2024

@zdavatz - Can you try out b1e500f?

@zdavatz
Copy link

zdavatz commented Jan 27, 2024

sure! Can I just do a git pull for the latest update?

I done a git clone this time. Now I get:

~/.software/bulk_extractor> ./bootstrap.sh
submodule be20_api is not present.

@simsong
Copy link
Owner Author

simsong commented Jan 27, 2024

When you do a git clone, you need to add the --recursive flag, because there are submodules.

Alternatively, you can do a git submodule init and git submodule update

This was referenced Jan 27, 2024
@zdavatz
Copy link

zdavatz commented Jan 28, 2024

I done that all, but still no luck:

~/.software/bulk_extractor> git submodule init
~/.software/bulk_extractor> git submodule update
Klone nach '/home/zeno/.software/bulk_extractor/dfxml_schema'...
Klone nach '/home/zeno/.software/bulk_extractor/src/be20_api'...
Submodul-Pfad 'dfxml_schema': 'f2a702e401dd15802ec8558b42c496a1184a0486' ausgecheckt
Submodul-Pfad 'src/be20_api': 'c031194542beed802c6303ac7c50904d10a5b67e' ausgecheckt
~/.software/bulk_extractor> ./bootstrap.sh
submodule be20_api/dfxml_cpp is not present.

@zdavatz
Copy link

zdavatz commented Jan 28, 2024

Ok, this worked:
git clone --recursive https://github.com/simsong/bulk_extractor.git

this did not work:

git submodule init
git submodule update

@simsong
Copy link
Owner Author

simsong commented Jan 28, 2024 via email

@zdavatz
Copy link

zdavatz commented Jan 28, 2024

Ok, configure goes through, but make -j9 still fails.

 495 |         if ( std::filesystem::exists( sc.outdir/"report.xml" )){
      |                   ^~~~~~~~~~
bulk_extractor.cpp:495:42: Fehler: »struct scanner_config« hat kein Element namens »outdir«
  495 |         if ( std::filesystem::exists( sc.outdir/"report.xml" )){
      |                                          ^~~~~~
bulk_extractor.cpp:504:37: Fehler: »struct scanner_config« hat kein Element namens »input_fname«
  504 |         p = image_process::open( sc.input_fname, cfg.opt_recurse, cfg.opt_pagesize, cfg.opt_marginsize );
      |                                     ^~~~~~~~~~~
bulk_extractor.cpp:504:104: Fehler: »image_process::open« kann nicht als Funktion verwendet werden
  504 |         p = image_process::open( sc.input_fname, cfg.opt_recurse, cfg.opt_pagesize, cfg.opt_marginsize );
      |                                                                                                        ^
bulk_extractor.cpp:507:73: Fehler: »struct scanner_config« hat kein Element namens »input_fname«
  507 |         cerr << "error: file " << e.what() << " is in directory " << sc.input_fname << std::endl;
      |                                                                         ^~~~~~~~~~~
bulk_extractor.cpp:511:71: Fehler: »struct scanner_config« hat kein Element namens »input_fname«
  511 |         cerr << "       then place them in a sub directory of " << sc.input_fname << std::endl;
      |                                                                       ^~~~~~~~~~~
bulk_extractor.cpp:539:50: Fehler: »struct scanner_config« hat kein Element namens »outdir«
  539 |     dfxml_writer *xreport = new dfxml_writer( sc.outdir / Phase1::REPORT_FILENAME, false ); // do not make DTD
      |                                                  ^~~~~~
bulk_extractor.cpp:547:23: Fehler: »struct scanner_config« hat kein Element namens »input_fname«
  547 |     validate_path( sc.input_fname );
      |                       ^~~~~~~~~~~
bulk_extractor.cpp:547:5: Fehler: »validate_path« wurde in diesem Gültigkeitsbereich nicht definiert
  547 |     validate_path( sc.input_fname );
      |     ^~~~~~~~~~~~~
bulk_extractor.cpp:565:38: Fehler: »struct scanner_config« hat kein Element namens »input_fname«
  565 |         cout << "Input file: " << sc.input_fname << std::endl ;
      |                                      ^~~~~~~~~~~
bulk_extractor.cpp:566:44: Fehler: »struct scanner_config« hat kein Element namens »outdir«
  566 |         cout << "Output directory: " << sc.outdir << std::endl ;
      |                                            ^~~~~~
bulk_extractor.cpp:600:46: Fehler: »struct scanner_config« hat kein Element namens »input_fname«
  600 |     xreport->xmlout( "provided_filename", sc.input_fname ); // save this information
      |                                              ^~~~~~~~~~~
make[2]: *** [Makefile:1438: scan_aes.o] Fehler 1
make[2]: *** [Makefile:1438: bulk_extractor_scanners.o] Fehler 1
make[2]: *** [Makefile:1438: notify_thread.o] Fehler 1
make[2]: *** [Makefile:1438: bulk_extractor.o] Fehler 1
make[2]: Verzeichnis „/home/zeno/.software/bulk_extractor/src“ wird verlassen
make[1]: *** [Makefile:526: all-recursive] Fehler 1
make[1]: Verzeichnis „/home/zeno/.software/bulk_extractor“ wird verlassen
make: *** [Makefile:466: all] Fehler 2

@zdavatz
Copy link

zdavatz commented Jan 28, 2024

@zdavatz - Can you try out b1e500f?

this commit is in the latest git pull right?

My repo is here: 88c2d72

@zdavatz
Copy link

zdavatz commented Jan 28, 2024

I do not have libewf installed, but AFAICT that should not be a problem.

@simsong
Copy link
Owner Author

simsong commented Jan 28, 2024

Correct, you should not need libewf.

It appears that git submodule update has a --recursive flag but git init does not. So you will need to use the git submodule foreach --recursive git init command (or something like that in addition to git init if you do not wish to do a new clone with git clone --recursive, which is what I recommend.

@zdavatz
Copy link

zdavatz commented Jan 28, 2024

ok, git clone --recursive works but I still get a make error: #452 (comment)

@simsong
Copy link
Owner Author

simsong commented Jan 28, 2024

Try switching to the branch rel-2.1.1 ?

@simsong
Copy link
Owner Author

simsong commented Jan 28, 2024

Can you post your full config.log file?
I can try to spin up a Kali Linux somewhere. Is it available on AWS?
Is there a way to run Kali linux on Github actions?
Kali Linux is based on Debian. There is no github actions running that provides debian linux. Do you know if I can run it under docker?

@zdavatz
Copy link

zdavatz commented Jan 29, 2024

Can you post your full config.log file? I can try to spin up a Kali Linux somewhere. Is it available on AWS? Is there a way to run
Kali linux on Github actions? Kali Linux is based on Debian. There is no github actions running that provides debian linux. Do
you know if I can run it under docker?

you can definitely do a github actions build from source. Config log is attached.

config.log

Configure runs fine for me.

@simsong
Copy link
Owner Author

simsong commented Jan 29, 2024 via email

@zdavatz
Copy link

zdavatz commented Jan 29, 2024

@simsong
Copy link
Owner Author

simsong commented Jan 29, 2024

Thanks. It does.
I looked through your config file. You are compiling with C++17. Nothing obviously is wrong. I'll give this a whirl and see what happens.

@zdavatz
Copy link

zdavatz commented Jan 29, 2024

Thank you!

@simsong simsong changed the title Make bulk_extractor compile under Kali Linux Make bulk_extractor compile under Debian Jan 30, 2024
@simsong
Copy link
Owner Author

simsong commented Jan 30, 2024

I'm trying to compile under a debian container and I can't get that to work either. This is a deeper problem. Somebody who knows Debian or Kali Linux, which is based on Debian, needs to fix this.

@zdavatz
Copy link

zdavatz commented Jan 30, 2024

On which Linux do you normally build?

@simsong
Copy link
Owner Author

simsong commented Jan 30, 2024 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants