Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

is there any reason no session or constant value graph after execution not available in python land #108

Open
yupbank opened this issue May 12, 2017 · 3 comments

Comments

@yupbank
Copy link
Contributor

yupbank commented May 12, 2017

Hi, I was trying to try a logistic regression with tensorframe in python, but since i don't get to access the execution session and also the graph after execution, is there any reason that is kept from the user?

@yupbank yupbank changed the title is there any reason no session or constant value graph after execution not available in python lab is there any reason no session or constant value graph after execution not available in python land May 12, 2017
@thunterdb
Copy link
Contributor

Yes, the execution session is fully managed on the workers and you do not have access to the sessions. This has a number of benefits such as allowing the sessions to be transparently multiplexed.

I have not tried these solutions yet, but if you want to collect some variables from the workers, there are a couple of ways, I believe:

  • for asynchronous communication, you should be able to use the primitives from tensorflow. The only issue concerns retrieving the final batch, but in most algorithms, the last batch is not so important
  • for synchronous communication, you should be able use tfs.reduce, once I add the session caching. You run a first map_rows phase to fill the variables, and then in a second phase, you merge these variables using reduce.

The second option requires a few incremental changes on the scala side to work though. I am a bit busy right now, but I should be able to take a look at it in three weeks - unless you want to take a look first.

@yupbank
Copy link
Contributor Author

yupbank commented May 16, 2017

cool cool, I'll look at it when i got time..

btw, is there a google forum or something so we can communicate more freely

@yupbank
Copy link
Contributor Author

yupbank commented May 26, 2017

Hi, @thunterdb so can you give me some hint on use the primitives from tensorflow for retrieving data from running graph? I'm looking into it but doesn't get any clue

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants