Jump to content
Plastic SCM forums are now in Unity. Click here to open the new forum ×

"Memory stream is not expandable." on checkin

Doddler

By Doddler
in General

Recommended Posts

Doddler Newbie

Doddler

Posted
Posted

I'm relatively new to using PlasticSCM, and am trialing it for use for my current project. I'm running PlasticSCM server set up on a remove VM on Azure (A1 size), using a local MySQL database backend. The remote server is a conscious decision as users that may be accessing the project will be doing so from remote locations. My project is a Unity3d project, and well, I've got a lot of binary assets (about 4Gb worth). While preparing changes is understandably slow, but I've gotten it to checkin, but it seems to fail on the confirming checkin step. Even with much smaller checkins (in all but the smallest updates), I receive error messages from the server.

 

For speed sake, I'm using the command line to try to commit, and the output is something as follows:

I:\Projects\ProjectFolder>cm ci "Assets\BaseAssets\ImageDefinitions" -c "image definitions" --all
The selected items are about to be checked in. Please wait ...
Assembling checkin data
Validating checkin data
Uploading file data
Uploaded 0 bytes of 16.75 MB (0%)
Confirming checkin operation
There has been an unexpected error "Memory stream is not expandable.". For more information check the server log.

This checkin is relatively small, but still causing server errors. On the server side of things, it gets this output:

2015-12-08 14:51:15,662 00000000-0000-0000-0000-000000000000 NT AUTHORITY\SYSTEM at DAN-WIN10 INFO  UpdatePerf - TryCheckin operation [235] ms
2015-12-08 14:51:15,662  NT AUTHORITY\SYSTEM at  INFO  ChannelCall - recb:1337775|rect:7391|sentb:   320|sendt:  0|prt:    2672|th:    7|dest:   0|mt:    1485|sert:   0|zip:   0|  108.181.xxx.xxx|TryCheckIn
2015-12-08 14:51:16,233  NT AUTHORITY\SYSTEM at  INFO  ChannelCall - recb:   607|rect:  0|sentb:253716|sendt:265|prt:     235|th:    7|dest:   0|mt:     156|sert:  32|zip:  47|  108.181.xxx.xxx|GetNewRepositoryIds
2015-12-08 14:52:21,635  NT AUTHORITY\SYSTEM at  INFO  ChannelCall - recb:6845063|rect:35625|sentb:   290|sendt:  0|prt:   23921|th:    7|dest:   0|mt:   21687|sert:   0|zip:   0|  108.181.xxx.xxx|SetObjectsData
2015-12-08 14:53:31,925  NT AUTHORITY\SYSTEM at  INFO  ChannelCall - recb:6880778|rect:37312|sentb:   290|sendt:  0|prt:   32657|th:    7|dest:   0|mt:   30360|sert:   0|zip:   0|  108.181.xxx.xxx|SetObjectsData
2015-12-08 14:54:56,672  NT AUTHORITY\SYSTEM at  INFO  ChannelCall - recb:6876910|rect:30656|sentb:   290|sendt:  0|prt:   53594|th:    7|dest:   0|mt:   51235|sert:   0|zip:   0|  108.181.xxx.xxx|SetObjectsData
2015-12-08 14:56:02,928  NT AUTHORITY\SYSTEM at  INFO  ChannelCall - recb:6879523|rect:23500|sentb:   290|sendt:  0|prt:   42453|th:    7|dest:   0|mt:   40406|sert:   0|zip:   0|  108.181.xxx.xxx|SetObjectsData
2015-12-08 14:56:10,887  NT AUTHORITY\SYSTEM at  INFO  ChannelCall - recb:1002464|rect:2844|sentb:   290|sendt:  0|prt:    5046|th:    7|dest:   0|mt:    4859|sert:   0|zip:   0|  108.181.xxx.xxx|SetObjectsData
2015-12-08 14:56:37,667 17c907c1-aac3-4d84-bf54-90a84d3e7166 NT AUTHORITY\SYSTEM at DAN-WIN10 INFO  UpdatePerf - 		CmDataReader- Execute 125 ms. [SELECT d.icompression, d.bdata FROM revisiondata d  WHERE d.fidobject = ?revId (?revId=[4])]
2015-12-08 15:04:43,526 17c907c1-aac3-4d84-bf54-90a84d3e7166 NT AUTHORITY\SYSTEM at DAN-WIN10 ERROR Operations - OnError catching exception [Memory stream is not expandable.] - Plastic server version: 5.4.16.707
2015-12-08 15:04:43,635  NT AUTHORITY\SYSTEM at  ERROR ExceptionTracerSink - Dumping in-transit exception:There has been an unexpected error "Memory stream is not expandable.". For more information check the server log.

2015-12-08 15:04:43,733  NT AUTHORITY\SYSTEM at  INFO  ChannelCall - recb:6212855|rect:23109|sentb:  3242|sendt:  0|prt:  489344|th:    7|dest:   0|mt:  487750|sert:  15|zip:   0|  108.181.xxx.xxx|CheckIn
2015-12-08 15:04:43,803 17c907c1-aac3-4d84-bf54-90a84d3e7166 NT AUTHORITY\SYSTEM at DAN-WIN10 INFO  Operations - Rollback repository transaction 17c907c1-aac3-4d84-bf54-90a84d3e7166
2015-12-08 15:05:20,107 17c907c1-aac3-4d84-bf54-90a84d3e7166 NT AUTHORITY\SYSTEM at DAN-WIN10 ERROR Transaction - Error rolling back explicit transaction 17c907c1-aac3-4d84-bf54-90a84d3e7166. Timeout expired.  The timeout period elapsed prior to completion of the operation or the server is not responding.
2015-12-08 15:05:20,107  NT AUTHORITY\SYSTEM at  INFO  ChannelCall - recb:   642|rect:  0|sentb:   290|sendt:  0|prt:   36297|th:    7|dest:   0|mt:   36297|sert:   0|zip:   0|  108.181.xxx.xxx|RepRollbackTransaction
2015-12-08 15:07:28,875  NT AUTHORITY\SYSTEM at  INFO  ChannelCall - recb:234528|rect:532|sentb:   290|sendt:  0|prt:  128171|th:    7|dest:   0|mt:  128156|sert:   0|zip:   0|  108.181.xxx.xxx|RemoveFilesData
2015-12-08 15:07:28,921 (null) NT AUTHORITY\SYSTEM at (null) INFO  Channel - Connection    9 from 108.181.xxx.xxx closed

I'm not sure exactly how to troubleshoot this particular issue, as searching for the error message returns pretty much nothing. It could, as the message suggests, be a memory related issue, but I'm unsure how to identify or troubleshoot that case either.

 

Any idea on what could be causing these issues, or what steps I should take? Thanks!

Link to comment
Share on other sites
Doddler Newbie

Doddler

Posted
  • Author
Posted

To give an update, I've now set up a local Plastic server using SQLite database back end, and still receiving the same errors. I'm not entirely sure what's causing the issue at this point, since unlike the VM there's an abundance of memory available. Perhaps an issue with some of the data? This is all using the command line mind you, it takes 20~30 minutes to pull up the pending changes dialog so I've been avoiding using the UI for this. From what I've heard, that's also not normal.

Link to comment
Share on other sites
Doddler Newbie

Doddler

Posted
  • Author
Posted

I guess I'll give an update. For some reason it really did not like having a very large number of text files in a single directory. After splitting the files into smaller groups and folders, and committing them in smaller batches, the issue appears to have gone away. So for the record, 100,000 small text files in a single folder, even if the total file size is rather small, is bad for plasticscm.

Link to comment
Share on other sites
calbzam Proficient

calbzam

Posted
Posted

Hi,

 

Regarding the pending changes view slowness, if you click on its preferences you will be able to reconfigure it to be much more faster. Could you also run the "cm iostats" command? Just to check your disk and network performance.

 

Could you also review this article to fine tune MySQL for Plastic? https://www.plasticscm.com/documentation/administration/plastic-scm-version-control-administrator-guide.shtml#C8_Mysql_Tune

 

We run performance tests every release, so let´s to figure out why it´s not properly working in your scenario.

 

Regards,

Carlos.

Link to comment
Share on other sites

Archived

This topic is now archived and is closed to further replies.

Go to topic listing
×
×
  • Create New...