Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

devcount always stays as 1, no replication of files #78

Open
GoogleCodeExporter opened this issue Mar 16, 2015 · 2 comments
Open

devcount always stays as 1, no replication of files #78

GoogleCodeExporter opened this issue Mar 16, 2015 · 2 comments

Comments

@GoogleCodeExporter
Copy link
Contributor

What steps will reproduce the problem?
1. I set "mogadm class modify mydomain myclass --mindevcount=3"

2. I check "mogadm class list" (looks good)
[administrator@mogTracker ~]$ mogadm class list
 domain               class                mindevcount   replpolicy   hashtype
-------------------- -------------------- ------------- ------------ -------
 mydomain             default                   2        MultipleHosts() NONE   
 mydomain             myclass                   3        MultipleHosts() NONE

3. I Upload a file "mogupload --domain=mydomain --class=myclass 
--key='myclass:test01' --file=test  --trackers=10.10.1.216:7001"

4. Now check the file and see only 1 copy "mogfileinfo --tracker=10.10.1.216 
--domain=mydomain --key='myclass:test01'"
- file: myclass:test01
     class:              myclass
  devcount:                    1
    domain:             mydomain
       fid:                   51
       key:       myclass:test01
    length:                    7
 - http://10.10.1.217:7505/dev11/0/000/000/0000000051.fid

5. Now I check with mogstats and get this,
[administrator@mogTracker ~]$ mogstats
Fetching statistics... (all)

Statistics for devices...
  device     host                   files     status
  ---------- ---------------- ------------ ----------
  dev11      mogStor1            2      alive
  dev12      mogStor1            3      alive
  dev13      mogStor1            2      alive
  dev22      mogStor2            2      alive
  dev23      mogStor2            3      alive
  ---------- ---------------- ------------ ----------

Statistics for file ids...
  Max file id: 51

Statistics for files...
  domain               class           files    size (m)  fullsize (m)
  -------------------- ----------- ---------- ----------- -------------
  mydomain             myclass             1           0             0
  anotherD             Original            1           0             0
  anotherD             default            10           0             0
  -------------------- ----------- ---------- ----------- -------------

Statistics for replication...
  domain               class        devcount      files
  -------------------- ----------- ---------- ----------
  mydomain             myclass             1          1
  anotherD             Original            1          1
  anotherD             default             1         10
  -------------------- ----------- ---------- ----------

Statistics for replication queue...
  status                      count
  -------------------- ------------
  deferred                       12
  -------------------- ------------

Statistics for delete queue...
  status                      count
  -------------------- ------------
  -------------------- ------------

Statistics for general queues...
  queue           status                      count
  --------------- -------------------- ------------
  FSCK_QUEUE      overdue                        11
  --------------- -------------------- ------------

done



What is the expected output? What do you see instead?
When i setup mindevcount to 3 I expect to see 3 copies of the same file 
distributed to different devices.

What version of the product are you using? On what operating system?
Centos 6.4 min x64 

Please provide any additional information below.
1 tracker, 2 storage nodes with 3 drives each. 

[administrator@mogTracker ~]$ cat /etc/mogilefs/mogilefsd.conf 
db_dsn = DBI:mysql:mogilefsdb:host=mysql01;port=3306;mysql_connect_timeout=5
db_user = mogilefsuser
db_pass = mypassword
conf_port = 7001
listener_jobs = 5
node_timeout = 5
default_mindevcount = 1

[administrator@mogStor2 ~]$ cat /etc/mogilefs/mogstored.conf 
httplisten=0.0.0.0:7500
mgmtlisten=0.0.0.0:7501
docroot=/var/mogdata
server=none



Original issue reported on code.google.com by [email protected] on 10 Sep 2013 at 10:40

@GoogleCodeExporter
Copy link
Contributor Author

I'm running into this as well. I've checked syslog, run into debug mode, 
logging mogstored and mogilefsd output but there's no error about failed 
replication.

Original comment by [email protected] on 1 Oct 2013 at 11:36

@GoogleCodeExporter
Copy link
Contributor Author

Solved, see https://groups.google.com/forum/#!topic/mogile/2z3Ld621qUc
Downgrade to BRADFITZ/Sys-Syscall-0.23.tar.gz .

Original comment by [email protected] on 1 Oct 2013 at 1:10

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant