Evaluation Criteria:
After the implementation the system will be evaluated according to the following timescale:
- First Evaluation: It will be conducted immediately after implementation
- Second Evaluation:It will be conducted a month after implementation of system
- Third Evaluation: It will be conducted a year after the implementation of system
Evaluations will be conducted keeping the following factors under consideration:
- Speed and accuracy of the system
- Reliability and maintainability
- Efficiency and performance
- Effectiveness of the system
- Accuracy of cost-benefit estimates and development schedules
The evaluations will be conducted in the following manner:
- Employees: Managers, market analysts, stockbrokers and accountants will be interviewed.
- Member Users: Contacting all the users individually will be time consuming and problematic. Thus, all users will automatically get an evaluation form when they login to their account and once it is completed the results will be calculated and stored. Due to the nature of the form the users will be supplied questions of a closed nature only.
- The maintenance and helpdesk log sheets would be analyzed.
- All source documents, output reports and screen displays will also be examined.
- Training schedule, completeness and appropriateness will also be evaluated.
Apart from the above evaluation procedures the users and the company personnel will also be observed for a period of 3 days every evaluation period. The observations will be recorded by evaluators and then conveyed to the management.
Management Evaluation
Q: How long have you been working in this firm?
Response:
Q: Do you find any difference between the old system and the new one?
Response:
Q: By how much has your firm’s efficiency improved after the introduction of the system?
Response:
Q: What has been the general comment over the new system?
Response:
Q: Are your employees satisfied with the system?
Response:
Q: Are the employees comfortable with it?
Response:
Q: By how much has your serviced improved because of the new system?
Response:
Q: How successful are you in satisfying your customers because of the change in system?
Response:
Q: Do you have any suggestions or comments to make?
Response:
Member User Evaluation
Please take a couple of minutes to fill out this form in order to help us serve you better. Just put the appropriate number in the blanks provided. Thank you very much for your patience.
1-Excellent
2-Good
3-Average
4-Unsatisfactory
SYSTEM OUTPUT:
Accuracy of information - ____
Completeness of information - ____
Ease of Use - ____
Timeliness of Information - ____
USER INTERFACE:
Quality of Instructions - ____
Quality of Help Messages - ____
Ease of Use - ____
Appropriateness of Options - ____
HELP DESK FACILITIES:
Availability - ____
Knowledge - ____
Cooperation - ____
Reporting of Progress - ____
Communication Skills - ____
ONLINE TRAINING:
Completeness - ____
Appropriateness - ____
Schedule - ____