CodingGorilla Posted July 23, 2012 Report Share Posted July 23, 2012 I have a workspace that has over 50,000 files, and it takes on the order of 20+ minutes for the Pending Changes view to "Find changes in the workspace". Is this normal? Is there anyway I can speed this up?? Link to comment Share on other sites More sharing options...
cidico Posted July 23, 2012 Report Share Posted July 23, 2012 Hi Gorilla! Are you using the "Compare file content instead of timestamps" option in the Preference -> Other Options? Maybe unchecking this option could give you a performance boost Link to comment Share on other sites More sharing options...
CodingGorilla Posted July 23, 2012 Author Report Share Posted July 23, 2012 Hi Cidico, Nope that option is not checked. That's what puzzles me, I don't understand why it would take so long. Link to comment Share on other sites More sharing options...
cidico Posted July 23, 2012 Report Share Posted July 23, 2012 If you use the "cm findchanged", "cm findcheckout" do you get the same response time? Link to comment Share on other sites More sharing options...
CodingGorilla Posted July 23, 2012 Author Report Share Posted July 23, 2012 Nope, those both return in just a second or so. I can see, using Process Monitor, that plastic.exe is grinding through all the files (almost acting like it's comparing them) and also a lot of temp files too, so I'm not sure what it's doing. I can provide the traces from Process Monitor if that would be helpful. Link to comment Share on other sites More sharing options...
cidico Posted July 23, 2012 Report Share Posted July 23, 2012 I had a problem like this one you're saying but with a lot less files. But it was happening randomly. After some builds this seems to be solved. I was thinking that could be my work machine that was slow since it was not happening at home (where my machine is MUCH MUCH MUCH more powerful). Let's wait for our savior Manu! Link to comment Share on other sites More sharing options...
CodingGorilla Posted July 23, 2012 Author Report Share Posted July 23, 2012 Actually, after thing about it and double checking, both of those cm commands you asked about return no results at all. They should be returning about 2000 changes. Link to comment Share on other sites More sharing options...
manu Posted July 24, 2012 Report Share Posted July 24, 2012 sorry for my late answer, let's see I need you to do the following: 1) Post a screenshot of you pending changes view options panel, I want to review your enabled search options. 2) If you have the "Show manually renames/mode items" option enabled, disable it and refresh the view, tell me if it's faster. Link to comment Share on other sites More sharing options...
CodingGorilla Posted July 24, 2012 Author Report Share Posted July 24, 2012 Could it have been just the sheer number of changed files that needed to be committed? At the time I had over 2500 files that needed to be committed; after the commit it seems to be functioning at a normal pace. Link to comment Share on other sites More sharing options...
manu Posted July 24, 2012 Report Share Posted July 24, 2012 I'm not sure, can you tell me if they were checked-out items or only "changed"? Do you have the option "Compare file contest instead of time stamps when determining changed status" enable at the Plastic SCM preferences wizard? Link to comment Share on other sites More sharing options...
CodingGorilla Posted July 24, 2012 Author Report Share Posted July 24, 2012 Here's a screenshot of my pending changes option; http://screencast.com/t/rHBCBwoCW And here's my "Other options: http://screencast.com/t/NZ3Zh1bpdg The files were not checked out, they were just changed. Link to comment Share on other sites More sharing options...
manu Posted July 24, 2012 Report Share Posted July 24, 2012 Thanks for the info CodingGorilla, I'll try to reproduce the issue in my computer with a huge number of changed files. If it happens again to you don't hesitate in contact us, I'll get connected with you to debug the issue. Link to comment Share on other sites More sharing options...
CodingGorilla Posted July 24, 2012 Author Report Share Posted July 24, 2012 I just realized the workspace was being accessed through a junction, I wonder if that also had an impact. I changed it so it goes through the real path, so I'll keep an eye out and see if it recurs. Link to comment Share on other sites More sharing options...
manu Posted July 24, 2012 Report Share Posted July 24, 2012 Ok! Thanks for the extra info! Link to comment Share on other sites More sharing options...
psantosl Posted July 24, 2012 Report Share Posted July 24, 2012 Hi there, We test with larger workspaces, about 400k files. In fact we have customers using wks this size on a daily basis. My personal workspace is about 30k files and once the disk is warmed up, it takes two seconds to find changes. We've to figure out what is slowing you down! Link to comment Share on other sites More sharing options...
Olaf Kober Posted July 25, 2012 Report Share Posted July 25, 2012 Hi! We had similar performance problems with pending changes in a workspace with about 8000 files, where ~2000 files were changed. Sometimes it took about 30 seconds to update. In our case it seems that our virus scanner (Symantec Endpoint Protection) was slowing it down. Excluding our workspaces and also the temp-folder from Realtime Protection does the trick. Now we have refresh times of 1-2 seconds. Link to comment Share on other sites More sharing options...
manu Posted July 25, 2012 Report Share Posted July 25, 2012 Brilliant! Very interesting! Thanks for sharing it! I hate anti-virus software Link to comment Share on other sites More sharing options...
immitev Posted August 6, 2012 Report Share Posted August 6, 2012 We have similar issue with large number of private items (maybe tens of thousands). Unchecking the "Show private items" in the client made a huge difference in performance. No more waiting for 20 or more minutes -> the updates now take a couple of seconds. Unfortunately this option can't be used with the Visual Studio integration and basically we are now doing check-ins outside VS.NET. It's not very convenient, but at least, we can check-in quickly Link to comment Share on other sites More sharing options...
manu Posted August 7, 2012 Report Share Posted August 7, 2012 Hi immitev, can you please issue the following command and postus the putput: cm iostats Link to comment Share on other sites More sharing options...
immitev Posted August 8, 2012 Report Share Posted August 8, 2012 Performing network tests with server: 10.10.10.144:8087. Please wait... Upload speed = 328 Mbps. Time uploading 16MB = 390ms. Server: 10.10.10.144:8087 Download speed = 680 Mbps. Time downloading 16MB = 187ms. Server: 10.10.10.144:8087 Performing disk speed test on path: C:\Users\imitev\AppData\Local\Temp\PlasticSCM_IOStats. Please wait... Disk write speed = 103 MB/s. Time writing 512MB = 4960 ms. Disk read speed = 1822 MB/s. Time reading 512MB = 281 ms. Link to comment Share on other sites More sharing options...
manu Posted August 8, 2012 Report Share Posted August 8, 2012 Do you have the Plasctic SCM workspace on the C:\ drive? Link to comment Share on other sites More sharing options...
immitev Posted August 8, 2012 Report Share Posted August 8, 2012 Yes, the main workspace I work on is on C:\. The performance lag is not just on my machine, but on all developers'. We have similar machines, which are not bad (Windows 7 rates mine: 5.9 hard drive and 7.6 for processor and memory). I have only MSFT Security Essentials as anivirus and turning it off doesn't seem to improve the speed. Just to note that Pending Checkins loading hasn't always been terribly slow in VS.NET. It seems that if we haven't displayed"Show pending changes" for a while, it suddenly can get very slow. Once the pending changes have been loaded, if we try again, the results shows up just for up 1-5 seconds. Not sure if this depends on other circumstances, but it seems that neither modifying or adding items locally, nor changes in the repository by other devs affect this. Since we didn't succeed to find a reliable pattern why this happens, we just decided to stick with the PlasticSCM client (with turned off option for private files). I've turned on the logging via C:\Program Files\PlasticSCM4\client\plastic.log.conf and can send you some results (strangely, the log file, specified in a RollingLogFileAppender I've setup, doesn't get always updated immediately after doing an action), Does the "Update time" lines reflect the speed? If you search in files for "Update time" (e.g. with Notepad++ is pretty nice), you'll see that it varies a lot. Link to comment Share on other sites More sharing options...
manu Posted August 8, 2012 Report Share Posted August 8, 2012 I'm almost sure that the thing is related with the IO performance since the second time you refresh the view takes 1-5 seconds and the Plastic GUI doesn't cache anything :S Do you think it's possible to schedule a gotomeeting session in order to perform some tests? Link to comment Share on other sites More sharing options...
immitev Posted August 17, 2012 Report Share Posted August 17, 2012 Hi, I've found some time today to conduct some additional tests in the PlasticSCM client (outside VS.NET). It confirmed that "Show private items" affects the speed significantly (at least on my machine). When it's turned off, the pending changes come up almost instantly. But when it's on, it takes about 6-7 minutes to show the pending changes (+ 32500 private items). Strangely, on previous attempts last week, it seemed that after each turning it off-and-on the pending changes were shown faster, as if some caching was done, but today for 5 times in a row it was in the range of 6-7 minutes. I am not ruling out a possibility of some disk issue, though I can't explain how it could spread to all computers of my colleagues, but who knows... Could you point to some disk benchmarking tools or send some instructions for further experiments (not sure when a gotomeeting can be scheduled)... Link to comment Share on other sites More sharing options...
manu Posted August 17, 2012 Report Share Posted August 17, 2012 Ok, let's try the following, download and extract the batch file: timecmd.zip And then issue the following command in the root directory of your workspace: x:\PlasticSCMWorkspace>timecmd dir /S > test.txt Then review the last line of the "test.txt" file and tell us how long does the command takes. Repeat the command another time and tell us the new time, and then refresh the pending changes view. One question, how many private items are you having in the workspace? Link to comment Share on other sites More sharing options...
Recommended Posts
Archived
This topic is now archived and is closed to further replies.