Curriki

Big performance degradation

Details

  • Type: Bug Bug
  • Status: Closed Closed
  • Priority: Major Major
  • Resolution: Fixed
  • Affects Version/s: 1.10.6 Facebook Connect / Improved Login / Join
  • Fix Version/s: 1.13
  • Component/s: None
  • Labels:
    None
  • Similar issues:
    CURRIKI-150Performance issues
    CURRIKI-463Update Members Home Page http://beta.curriki.org/xwiki/bin/view/Members/ with the three big orange buttons and link to add wizard
    CURRIKI-1394Edit Masthead Screen - The big size logo pushes the left nav down
    CURRIKI-5282Group Activity feed XML times out if big, need paging added
    CURRIKI-3143Performance: Up the Cache on Production to 3,000 K
    CURRIKI-4082PROJECT: Performance Enhancement
    CURRIKI-4644Correlate Server monitor performance errors and warning to Web, app and DB logs.
    CURRIKI-3953Make use of Javascript extensions to improve performance
    CURRIKI-1502Group image too big (Full size) in view page for group resoruces
    CURRIKI-282Dialog boxes are positioned badly or are to big to fit editor window.

Description

The average time to deliver a page used to be, from Washington, around 0.6s it is now in average more than 1.2 seconds.
The CPU load has gotten high these days (till 180%) but also goes down to 0.5% from time to time.

We do not know yet why but it seems that there are things that slow down the server.

Activity

Ascending order - Click to sort in descending order
Hide
Permalink
Paul Libbrecht added a comment -

One of the main suspects is the live-validation feature which does submit a DB query at each request.

I have now uploaded on current a version that does not do the live-validation, only when submitting.

If this version on current is running ok we could deploy it on prod (it's just a few sources) and see if we get less performance degradation alarms.

Thank you Todd to check.

paul

Show
Paul Libbrecht added a comment - One of the main suspects is the live-validation feature which does submit a DB query at each request. I have now uploaded on current a version that does not do the live-validation, only when submitting. If this version on current is running ok we could deploy it on prod (it's just a few sources) and see if we get less performance degradation alarms. Thank you Todd to check. paul
Hide
Permalink
Paul Libbrecht added a comment -

Now that the monitoring tool is becoming usable I see an amount of times whe sun.awt.image.ImageFetcher.run is running. This is non-sense in a server environment!

I guess it is caused by the facebook registrations trying to fetch the profile URL.
Yet another hypothesis.

paul

Show
Paul Libbrecht added a comment - Now that the monitoring tool is becoming usable I see an amount of times whe sun.awt.image.ImageFetcher.run is running. This is non-sense in a server environment! I guess it is caused by the facebook registrations trying to fetch the profile URL. Yet another hypothesis. paul
Hide
Permalink
Paul Libbrecht added a comment -

More looks reveal a bit more. We'll probably do more of that.

Among the things that appear frequently are the statistics queries which made Ludovic indeed choke, it may be worth an investigation.

Another is that things from this group sound often queried: Coll_Group_IntegratingTechnologyintoSecondaryCurriculum-2040

  • currently featured?
  • some missing caching?

paul

Show
Paul Libbrecht added a comment - More looks reveal a bit more. We'll probably do more of that. Among the things that appear frequently are the statistics queries which made Ludovic indeed choke, it may be worth an investigation. Another is that things from this group sound often queried: Coll_Group_IntegratingTechnologyintoSecondaryCurriculum-2040 currently featured? some missing caching? paul
Hide
Permalink
Joshua Marks added a comment -

This group is a highly acvtive one-> Coll_Group_IntegratingTechnologyintoSecondaryCurriculum-2040 it is a Florida Univercity building resources.We want them all to be like this.

Show
Joshua Marks added a comment - This group is a highly acvtive one-> Coll_Group_IntegratingTechnologyintoSecondaryCurriculum-2040 it is a Florida Univercity building resources.We want them all to be like this.
Hide
Permalink
Paul Libbrecht added a comment -

The states of MySQL are probably a sign of heavy activity.
Among them, quite may threads show the state "statistics" which indicates an exploration to decide on a query execution plan by random exploration as explained on:
http://www.linuxtopia.org/online_books/database_guides/mysql_5.1_database_reference_guide/show-processlist.html
paul

Show
Paul Libbrecht added a comment - The states of MySQL are probably a sign of heavy activity. Among them, quite may threads show the state "statistics" which indicates an exploration to decide on a query execution plan by random exploration as explained on: http://www.linuxtopia.org/online_books/database_guides/mysql_5.1_database_reference_guide/show-processlist.html paul
Hide
Permalink
Paul Libbrecht added a comment -

delaying.
We really are only able to investigate that once the new core is deployed.
paul

Show
Paul Libbrecht added a comment - delaying. We really are only able to investigate that once the new core is deployed. paul
Hide
Permalink
Paul Libbrecht added a comment -

to be done after clustering...
paul

Show
Paul Libbrecht added a comment - to be done after clustering... paul
Hide
Permalink
Joshua Marks added a comment -

I think this can be closed

Show
Joshua Marks added a comment - I think this can be closed
Hide
Permalink
Joshua Marks added a comment -

This seems to no longer be an issue. Please verify or re-open.

Show
Joshua Marks added a comment - This seems to no longer be an issue. Please verify or re-open.

People

  • Assignee:
    Todd Sherman
    Reporter:
    Paul Libbrecht
Vote (0)
Watch (3)

Dates

  • Created:
    Updated:
    Resolved:
    Date of First Response: